-- Logs begin at Thu 2022-08-04 04:11:09 UTC, end at Thu 2022-08-04 05:35:01 UTC. -- Aug 04 04:57:07.569251 dv-cinder-852072-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 04:57:07.578547 dv-cinder-852072-1-smb devstack@keystone.service[80649]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:57:07 2022] *** Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: nodename: dv-cinder-852072-1-smb Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: machine: x86_64 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: clock source: unix Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: pcre jit disabled Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: detected number of CPU cores: 4 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: current working directory: / Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: your processes number limit is 47680 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: your memory page size is 4096 bytes Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: detected max file descriptor number: 2048 Aug 04 04:57:07.580707 dv-cinder-852072-1-smb devstack@keystone.service[80649]: lock engine: pthread robust mutexes Aug 04 04:57:07.581473 dv-cinder-852072-1-smb devstack@keystone.service[80649]: thunder lock: enabled Aug 04 04:57:07.581473 dv-cinder-852072-1-smb devstack@keystone.service[80649]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 04:57:07.581473 dv-cinder-852072-1-smb devstack@keystone.service[80649]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:57:07.619790 dv-cinder-852072-1-smb devstack@keystone.service[80649]: Python main interpreter initialized at 0x560580e619c0 Aug 04 04:57:07.619790 dv-cinder-852072-1-smb devstack@keystone.service[80649]: python threads support enabled Aug 04 04:57:07.619790 dv-cinder-852072-1-smb devstack@keystone.service[80649]: your server socket listen backlog is limited to 100 connections Aug 04 04:57:07.619790 dv-cinder-852072-1-smb devstack@keystone.service[80649]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:57:07.620176 dv-cinder-852072-1-smb devstack@keystone.service[80649]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:57:07.620253 dv-cinder-852072-1-smb devstack@keystone.service[80649]: *** Operational MODE: preforking *** Aug 04 04:57:07.620496 dv-cinder-852072-1-smb devstack@keystone.service[80649]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:57:07.620496 dv-cinder-852072-1-smb devstack@keystone.service[80649]: spawned uWSGI master process (pid: 80649) Aug 04 04:57:07.620695 dv-cinder-852072-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 04:57:07.625630 dv-cinder-852072-1-smb devstack@keystone.service[80649]: spawned uWSGI worker 1 (pid: 80661, cores: 1) Aug 04 04:57:07.625630 dv-cinder-852072-1-smb devstack@keystone.service[80649]: spawned uWSGI worker 2 (pid: 80662, cores: 1) Aug 04 04:57:07.625630 dv-cinder-852072-1-smb devstack@keystone.service[80649]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:57:13.204404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:57:13.204404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: from cryptography.utils import int_from_bytes Aug 04 04:57:13.205238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:57:13.205238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: from cryptography.utils import int_from_bytes Aug 04 04:57:13.205376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:57:13.205376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: from cryptography.utils import int_from_bytes Aug 04 04:57:13.205376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:57:13.205376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: from cryptography.utils import int_from_bytes Aug 04 04:57:13.255574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:57:13.255766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:57:13.255984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] command line args: [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:57:13.256091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:57:13.256204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:57:13.256289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:57:13.256401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] command line args: [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:57:13.256486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ================================================================================ {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:57:13.256674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] admin_token = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.256751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:57:13.256853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ================================================================================ {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:57:13.256940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] config_dir = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] admin_token = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] config_source = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] config_dir = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] debug = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] config_source = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.257922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] debug = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.258948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_config_append = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_config_append = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_dir = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.259797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_file = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_dir = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_file = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.260968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.261888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.262005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.262734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.262863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.262976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.262976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.263868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] publish_errors = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] publish_errors = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.264986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.265910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] standard_threads = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] standard_threads = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] use_journal = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.266949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] use_json = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] use_journal = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] use_stderr = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] use_json = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] use_syslog = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] use_stderr = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.267961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] use_syslog = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.274599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.274691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:57:13.274770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.274853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.274853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.274980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.274980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.275853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.276893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.277921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.278886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.279943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.280979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.281945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.282909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.283956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.284931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.285982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.286957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.287963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.288961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.289937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.290939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.291991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.external = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.external = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.292925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.password = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.password = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] auth.token = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] auth.token = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.293805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.294947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.295925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.296938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.297942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.298977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.299983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.300913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.301907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.302982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.303958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.304089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.312964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.313987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.314942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.315882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.316985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.317997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.318949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.319980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.320937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.321955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.322955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.323897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.324503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.325935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.326896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] role.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] role.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] role.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] role.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.327868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.328907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.329888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.330993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.331880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.332969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.333992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.334899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.335953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.336949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.337945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.338938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.339811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.connection = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.340967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.connection = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.341959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342183 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.342960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.343863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.344905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:57:13.345826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:57:13.345826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:57:13.374644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.374903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.375049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.375209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.375354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.375487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.383608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.383763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.413939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.414211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.414415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.414653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.472985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.473204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.525177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.525423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.525580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.525722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.591677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.591932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.592932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.615999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.616992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.617107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.617190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.617324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.617406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.617536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.628377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.628713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.641702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.641941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.642900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.643033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.643115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.643258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.643475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:57:13.660606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.660817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:57:13.661154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.661252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.661343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:57:13.661420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:57:13.661612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.661755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.661873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.661953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:57:13.662131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.662212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.662388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.662468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.662717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.662977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.672341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.672620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.672892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.673173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.673253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.673482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.673755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.674041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.680092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.680960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.684840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.685118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.685398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.685677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.685758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.685960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.686851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.687860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.688159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.688431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.711050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.711981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.712576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.712856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.713500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.713779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.718073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.718351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.718634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.719124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.719406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.719689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.725299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.725542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.726303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.726589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.730657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.730804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.730989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.731933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732324 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.732867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.748785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.748885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.749066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.749151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.753038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.753132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.756237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.756339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.756536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.756636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.760950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.761042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.765060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.765681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.768251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.768553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.768850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.768932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.769811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.770012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.770293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.786465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.786749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.787006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.787091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.787275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.787358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.787545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.787808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.794195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.794749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.795754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.796325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.796585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.796862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.799170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.799452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.799685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.799767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.799991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.800089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.800291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.800374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.800581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.800862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.812305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.812581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.812861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.812947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.813140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.813982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.814066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.814269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.814548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.830275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.830860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.833314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.833876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.836272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.836866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.838761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.839419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.840326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.840612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.840904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.840987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.841268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.841566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.847371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.848026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.849021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.849640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.851992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.852284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.852566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.852649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.852840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.852924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.853154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.853430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.861103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.861403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.861502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.861683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.861769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.862036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.868584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.868864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.868948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:57:13.869145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.869959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.870898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.871172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.871251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.871994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.872906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.873102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.873278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:57:13.907559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560580e619c0 pid: 80662 (default app) Aug 04 04:57:13.907701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560580e619c0 pid: 80661 (default app) Aug 04 04:57:13.910978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7350-0334-4b3d-a605-d5cd4aa4f7f5 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:13.911275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7350-0334-4b3d-a605-d5cd4aa4f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:13.911556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f7350-0334-4b3d-a605-d5cd4aa4f7f5 None None] PATH_INFO: `/v3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:13.915850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Aug 4 04:57:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:22.772291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:22.772845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:22.772845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:22.777266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:22.783189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:22.783637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:22.783728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:22.855200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: INFO dbcounter [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] Registered counter for database keystone Aug 04 04:57:22.877927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:57:22.884210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writer thread running {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:57:23.067551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG passlib.handlers.bcrypt [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80662) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 04:57:23.067889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG passlib.handlers.bcrypt [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80662) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 04:57:23.122110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:23.124417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:23.257466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 04:57:23.396788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:23.466409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: INFO dbcounter [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] Registered counter for database keystone Aug 04 04:57:23.486042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG oslo_db.sqlalchemy.engines [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:57:23.492575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writer thread running {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:57:23.613684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a93280-217f-4b86-b6b4-1d01b91d2bd0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:23.618098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:23.618733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:23.619020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:23.619300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:23.628082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:23.681185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 04:57:23.681462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae711-774e-4834-b77a-8b707ead43ae admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:23.692494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Aug 4 04:57:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:57:23.699755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:23.715185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3306-bc6e-4963-86da-db5ecbea76ba None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:23.719826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:23.720994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:23.721282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:23.721559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] PATH_INFO: `/v3/projects/bc8951b8f50642578f4f541f71fa515c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:23.723059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] RBAC: Authorizing `identity:get_project(project_id=bc8951b8f50642578f4f541f71fa515c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:23.774225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 04:57:23.774563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e06c5f-5a6c-4bdb-9986-d00effb47084 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:23.779372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Aug 4 04:57:23 2022] GET /identity/v3/projects/bc8951b8f50642578f4f541f71fa515c => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:25.787189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763893c-728a-4d7f-bd1d-d0ee75c3c9fa None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:25.787730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763893c-728a-4d7f-bd1d-d0ee75c3c9fa None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:25.787730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763893c-728a-4d7f-bd1d-d0ee75c3c9fa None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:25.791848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:25.797747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:25.798167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:25.798293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:25.818784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:25.820313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:25.829354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 04:57:25.851534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763893c-728a-4d7f-bd1d-d0ee75c3c9fa None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:25.864670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763893c-728a-4d7f-bd1d-d0ee75c3c9fa None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:25.869006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:25.869641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:25.869925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:25.870201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:25.878122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:25.879927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2f4cd-f40d-4756-82d1-dde3b6e12156 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:25.888820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Aug 4 04:57:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:57:25.896356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:25.906596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea8e65-ad44-4077-9f43-afb01a2ab74b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:25.910956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:25.911593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:25.911876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:25.912189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:25.913555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:25.915369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb56da-d745-4918-a6c9-b0f01268c0db admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:25.916946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Aug 4 04:57:25 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:27.990540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f271-cc66-4bf6-89fb-f205571cb727 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:27.991027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f271-cc66-4bf6-89fb-f205571cb727 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:27.991027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f271-cc66-4bf6-89fb-f205571cb727 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:27.992402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:27.997777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:27.998287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:27.998377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.017784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:28.018992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:28.065101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26f09-9624-490e-897f-aa968da73774 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.065385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26f09-9624-490e-897f-aa968da73774 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.065664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac26f09-9624-490e-897f-aa968da73774 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.066995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:28.071866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.072189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.072471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.106764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:28.116119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG passlib.handlers.bcrypt [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80661) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 04:57:28.116554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG passlib.handlers.bcrypt [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80661) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 04:57:28.130189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.154381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.164474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:28.166083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:28.238344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6caa9-5da4-4854-bbd4-040c008d7778 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.271784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:28.275231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.275891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.276207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.276494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.289563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:28.299522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:28.300726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:28.301720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:28.302561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.302648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:57:28.307069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.391575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.409667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de4e1-272e-4e0c-a785-e225d67b2624 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.411230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6864950-1324-4cf8-a6f7-66cfd342c593 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.413570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.444930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.445555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.445833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.446108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.446836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:28.447142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:28.448609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:28.451183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.452163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.452453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.452738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.461505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:28.467865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.521701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:28.523292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:28.569855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1628c-aafb-4c41-b01e-05b367d42bbb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.628354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:28.636035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.640435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.713587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.714242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.714525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.714803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.716706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:28.718180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:28.719993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:28.725304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.739976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.767697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3eac-bf7b-4ecc-abe3-d89d59d1cb56 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.803950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.804750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.805033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.805309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.824790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:28.826854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:28.827837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6518-7368-408f-b969-088c6d733c84 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:57:28.844740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:28.845752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:28.846832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:57:28.846832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:57:28.846832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:57:28.846832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:28.846832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:57:28.851758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.862652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.863307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.863592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.863876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.865073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:28.866539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:28.868140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:28.874923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:28.908892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.956201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58ead-c0a6-4133-829f-82f4a304f52f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.957008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:28.976572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d8624-f4ff-4c00-8866-fceb3b3d40a4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:28.995435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:28.996357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:28.996692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:28.997038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:28.998428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:28.998801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:29.000505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e6fa-2b54-4903-8a3a-2a40d3a85bcb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:29.018914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:29.019619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:29.019829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:29.020155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:29.020539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:29.020970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.domain.id=default, user.id=fece46a4b9f24d8f8750a8912d1377ec) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:29.021287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:29.022751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7186da-ddb0-4aa7-bc00-a7599d68a327 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:29.030511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Aug 4 04:57:28 2022] GET /identity/v3/role_assignments?user.id=fece46a4b9f24d8f8750a8912d1377ec&scope.domain.id=default&role.id=5a02b24f89c148f78d88275904494739 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:31.430916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a75a1-5fb1-419f-a665-51824e61ef01 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:31.431799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a75a1-5fb1-419f-a665-51824e61ef01 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:31.432277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a75a1-5fb1-419f-a665-51824e61ef01 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:31.433762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:31.439501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:31.440431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:31.440909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:31.469511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:31.471089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:31.572915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:31.609004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a75a1-5fb1-419f-a665-51824e61ef01 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:31.757598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a75a1-5fb1-419f-a665-51824e61ef01 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:31.779371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:31.802490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:31.803492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:31.803994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:31.804588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:31.823854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-01d0e05c-115a-449c-b195-9db5ad9ca3fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:31.831578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:31.832506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:31.833259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:31.835638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 12/24] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:31.842081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:31.905606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8710-27f4-4f14-bdd9-9de6224acee9 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:31.906221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8710-27f4-4f14-bdd9-9de6224acee9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:31.906702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d8710-27f4-4f14-bdd9-9de6224acee9 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:31.908274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 13/25] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:31.920548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81084-1d3c-4b1b-97da-66296827b45d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:31.921401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81084-1d3c-4b1b-97da-66296827b45d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:31.921879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81084-1d3c-4b1b-97da-66296827b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:31.954251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d6f81084-1d3c-4b1b-97da-66296827b45d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:31.955373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d6f81084-1d3c-4b1b-97da-66296827b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:32.001480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.063122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f3f6a-cc66-4570-a1bb-84fd33f13535 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:32.095929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:32.097352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9025c4d-84ed-496a-8947-02c4578ec1cf None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.097647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9025c4d-84ed-496a-8947-02c4578ec1cf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.098037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9025c4d-84ed-496a-8947-02c4578ec1cf None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.101972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 15/27] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:32.104795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.105195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.105484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.113201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:32.113830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.114117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.114395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.115123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:32.115428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:32.116856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:32.139874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 13/28] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:32.140761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:32.145342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:32.146560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:32.317623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9a0d-fed7-478b-a18e-dbd6596f8e9e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:32.357759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:32.358399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.358683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.358955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.359745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:32.361206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcdd7c-fff8-46f2-8c7c-19464645b292 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:32.367776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.400899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:32.401849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:32.448888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.515378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e865-cddc-4a46-a011-76c8128032ea None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:32.551627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:32.552305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.552632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.552903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.554430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:32.555864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dcda4-3cb0-4de9-a02b-8d8dfdb880d5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:32.562573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 17/30] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:32 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:32.562573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5c52-e608-46eb-992a-f5688e5e102a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.562573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5c52-e608-46eb-992a-f5688e5e102a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.562573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5c52-e608-46eb-992a-f5688e5e102a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.562573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 18/31] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:32.566081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5c52-e608-46eb-992a-f5688e5e102a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 14/32] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 04:57:32 2022] POST /identity/v3/roles => generated 219 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8f7cb-f985-4802-acb0-483da4829e5b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8f7cb-f985-4802-acb0-483da4829e5b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8f7cb-f985-4802-acb0-483da4829e5b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 15/33] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:32.631706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8f7cb-f985-4802-acb0-483da4829e5b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:32.692901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5c52-e608-46eb-992a-f5688e5e102a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:32.717691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.742031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:32.742834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.743243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.743678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.744669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:32.746308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:32.752424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8f7cb-f985-4802-acb0-483da4829e5b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:32.794905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:32.798978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.798978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.798978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.800485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:32.810035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804eac-6a1c-41b9-89fb-f5d9066a8c61 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:32.810035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:32.810035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e6a4-5466-4995-a4e4-6d9d4e7f65b2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.810035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e6a4-5466-4995-a4e4-6d9d4e7f65b2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.810035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4e6a4-5466-4995-a4e4-6d9d4e7f65b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.827688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a5a4e6a4-5466-4995-a4e4-6d9d4e7f65b2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:32.831476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a5a4e6a4-5466-4995-a4e4-6d9d4e7f65b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:32.921490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:32.929925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:32.931294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:32.931600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:32.931883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:32.944809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 19/36] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 04:57:32 2022] POST /identity/v3/roles => generated 225 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:32.945888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:32.960701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:32.961957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:33.046366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 18/37] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:33.048309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.079288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8d22-c341-4bba-b0b8-d3c744fdcf07 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.123231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.123946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.124243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.124528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] PATH_INFO: `/v3/domains/default/users/fece46a4b9f24d8f8750a8912d1377ec/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.126765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fece46a4b9f24d8f8750a8912d1377ec, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.128450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bb6bd-e87c-483a-8b32-9315bbfa4d16 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.176448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcb5e6-c943-4568-bc56-7cbc7ac27417 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.199493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:33.210764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.211409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.211698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.212017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.220884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Aug 4 04:57:32 2022] PUT /identity/v3/domains/default/users/fece46a4b9f24d8f8750a8912d1377ec/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:33.222326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc325-6efb-43ad-844a-9f2e655009ec None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.222622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc325-6efb-43ad-844a-9f2e655009ec None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.222904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bc325-6efb-43ad-844a-9f2e655009ec None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.223519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.224228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 21/39] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:33.224951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bc325-6efb-43ad-844a-9f2e655009ec None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.225840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-ca0bace4-78a8-436f-b9fe-80d5964cb6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:57:33.243617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:33.244619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:33.245625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:57:33.245625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:57:33.245625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:57:33.245625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:33.247345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 19/40] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:33.249016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.249305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.249589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.267046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:33.270254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:33.271482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:33.368487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 20/41] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:33.370754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bc325-6efb-43ad-844a-9f2e655009ec None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.377022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.421418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.422067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.422392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.422675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.423414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.424900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.486271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 04:57:33 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:33.492605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.493975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd1cf-ce39-4f70-8ba4-55c96856265f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.507897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:33.551899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.553086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.553925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.554539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.557231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:33.557231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.561112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.586892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:33.593881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.634782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:33.671547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291d38-26eb-46d8-9190-c1dcaf7ce176 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.722437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.723109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.723451 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.723737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.725654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.727538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.729668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 23/44] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:33.736724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:33.763623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f132-697f-41c3-9980-9712329482d6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.801759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.802398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.802684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.802969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.803673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.805210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338958d5-e395-402e-951c-8d4089a4eea7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.861280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081044-92e8-4052-990e-e396a759a5fa None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:33.899481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:33.900149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:33.900438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:33.900724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:33.901459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:33.902960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202864a-2bf7-49ff-8e4b-d469bee964dc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:33.904852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:57:33 2022] POST /identity/v3/projects => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:57:34.000023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:57:33 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:35.314896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570659-3d09-4dc1-9169-e82f4087819b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:35.315418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570659-3d09-4dc1-9169-e82f4087819b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:35.315503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c570659-3d09-4dc1-9169-e82f4087819b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:35.316946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 23/47] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:35.322175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:35.322579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:35.322750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:35.330231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:35.341990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:35.343638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:35.409305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:35.431758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c570659-3d09-4dc1-9169-e82f4087819b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:35.452808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:35.536570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c570659-3d09-4dc1-9169-e82f4087819b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:35.573303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:35.573870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:35.574154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:35.574432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:35.584465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:35.589453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:35.590438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:35.591753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 24/49] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:35.597368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:35.695163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f056fc-3d5a-44cf-9706-e255ec8bf1ca None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:35.730920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:35.732413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:35.732526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:35.732747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:35.733469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:35.733774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:35.735167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:35.736871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:35.748580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 26/50] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:35.754318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:35.841967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:35.865313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edee43-b1e7-4a28-8335-f990d40c773a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:35.905088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:35.905761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:35.906897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:35.907196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:35.908602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:35.910115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:35.911786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 25/51] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:35 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:35.917387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:36.019716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31b46-ecc0-44cc-9a36-2ba5fd38df8e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:36.054162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:36.054815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.055101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.055381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.056533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:36.057988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c92626-6abf-4cff-83f4-57103b435b5d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:36.060206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 27/52] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:36.066475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:36.106126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c688f-bbc6-4504-a2f0-0cc854ffbe1e None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.106851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c688f-bbc6-4504-a2f0-0cc854ffbe1e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.107105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c688f-bbc6-4504-a2f0-0cc854ffbe1e None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.108526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 28/53] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:36.113824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.114120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.114402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.133020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:36.134247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:36.174207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f042a-4f4d-4939-9640-7d952f67595e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:36.195699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:36.204659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 29/54] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:36.209187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:36.209808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.210129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.210405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.211186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.domain.id=default, user.id=fece46a4b9f24d8f8750a8912d1377ec) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:36.211502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:36.212972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:36.219550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 26/55] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Aug 4 04:57:36 2022] GET /identity/v3/role_assignments?user.id=fece46a4b9f24d8f8750a8912d1377ec&scope.domain.id=default&role.id=5a02b24f89c148f78d88275904494739 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:36.228327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:36.344308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d3db9-72f5-4079-ac67-054a760954b9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:36.381170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:36.381788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.382073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.382354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.383529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:36.385034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0789-cc61-4900-a7df-505b4f23f855 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:36.386656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 30/56] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:36.393371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:36.407459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:36.500349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29b38-c57a-406b-9357-64cdcbff0df5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:36.534664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:36.535293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:36.535602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:36.535865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:36.536589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:36.538067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594cb08-4195-4642-aa76-d1af479b6968 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:36.635098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 27/57] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Aug 4 04:57:36 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:38.667303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cccbe-3c69-4647-924d-7dad98cb47e8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:38.667823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cccbe-3c69-4647-924d-7dad98cb47e8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:38.667959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cccbe-3c69-4647-924d-7dad98cb47e8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:38.669563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 31/58] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:38.674963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:38.675384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:38.675518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:38.693644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:38.694841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:38.752848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:38.762817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:38.787400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cccbe-3c69-4647-924d-7dad98cb47e8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:38.851959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:38.891295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cccbe-3c69-4647-924d-7dad98cb47e8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:38.926196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:38.926753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:38.927033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:38.927304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:38.928464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:38.929910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8ac6-ac44-44de-893c-6ad4086417cd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:38.931479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 32/60] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:38.937830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:39.035064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebffdd-48c8-4a7e-a620-0731076a5366 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:39.069812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:39.070439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:39.070718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:39.070992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:39.071687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:39.073183 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58141e-f7b7-47ba-a8f4-bd33b42767a1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:39.172167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 29/61] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:57:38 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:42.423082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a0e8-6362-4c0b-ba70-36557b0cce08 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.424147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a0e8-6362-4c0b-ba70-36557b0cce08 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.424654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a0e8-6362-4c0b-ba70-36557b0cce08 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.426196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 33/62] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:42.431632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb389b-1c21-4aeb-8cd8-5776fbc4d8af None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.432600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb389b-1c21-4aeb-8cd8-5776fbc4d8af None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.433079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb389b-1c21-4aeb-8cd8-5776fbc4d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.456999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8efb389b-1c21-4aeb-8cd8-5776fbc4d8af None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:42.458587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8efb389b-1c21-4aeb-8cd8-5776fbc4d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:42.520136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:42.553854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:42.595569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a0e8-6362-4c0b-ba70-36557b0cce08 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:42.617400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14eb9-b42c-48ef-9742-4d9b0223742c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.617704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14eb9-b42c-48ef-9742-4d9b0223742c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.617965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14eb9-b42c-48ef-9742-4d9b0223742c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.619503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 31/64] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:42.633538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ecd-5810-460b-b748-aa11289c3557 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.633919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ecd-5810-460b-b748-aa11289c3557 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.634104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ecd-5810-460b-b748-aa11289c3557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.668107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4b2c8ecd-5810-460b-b748-aa11289c3557 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:42.670067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4b2c8ecd-5810-460b-b748-aa11289c3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:42.749938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a0e8-6362-4c0b-ba70-36557b0cce08 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:42.752538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:42.754009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834b45-5bb3-4f0f-ba1f-8c47352b70af None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.754534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834b45-5bb3-4f0f-ba1f-8c47352b70af None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.755063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b834b45-5bb3-4f0f-ba1f-8c47352b70af None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.760647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 33/66] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:42.762518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.763018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.763499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.781882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:42.782729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:42.784195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:42.789440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:42.790328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.794255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.794255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.803872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:42.809099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:42.810441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:42.811221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:42.816749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:42.816749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:42.871536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 34/68] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:42.873513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:42.922617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:42.928277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d618e9-924e-488d-9c3e-2a88cbb5f19f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:42.964411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:42.964969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.965257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.965701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.976269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-785e501b-16bb-411e-8638-bdbcf8d1a071 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:42.981907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:42.982771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:42.983537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:42.984618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680dce4-e057-4bad-acb9-a3d3f984e7a1 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.984718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680dce4-e057-4bad-acb9-a3d3f984e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.984987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680dce4-e057-4bad-acb9-a3d3f984e7a1 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.986568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 36/70] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:42.987596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95bb6-b866-42d0-8756-23f17596a6ea None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:42.987998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95bb6-b866-42d0-8756-23f17596a6ea None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:42.988286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95bb6-b866-42d0-8756-23f17596a6ea None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:42.990924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 37/71] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:42.990924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95bb6-b866-42d0-8756-23f17596a6ea None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:42.993367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bea46-5376-4d78-9cb7-ad1538076d24 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.030159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.030810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.031097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.031375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.032133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:43.032449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.033870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.042526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 35/72] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.043444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.050427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.102125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95bb6-b866-42d0-8756-23f17596a6ea None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.136606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.137250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.138097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.138396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.143476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.146292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551475c4-a408-470c-ac02-32559b014d8f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.149312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-bd03526a-3be7-4021-ae6a-31fd46c77fc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:43.154732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:43.156430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 38/73] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:57:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:43.157912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.159242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.159242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.178213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:43.179447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:43.188586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.189363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.189753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.190118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.190935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:43.191421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.192969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b01e8-5806-46c1-969b-72843ea51f0d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.202504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 36/74] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.205565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.206129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.206417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.234085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:43.235827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:43.253045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 39/75] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:43.255427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.308018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.321075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 37/76] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:43.332102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.384648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6867b1e-2c26-419d-ac44-42ba9c046787 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.421650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.422314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.422473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.422589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.422863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.424267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.425759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.427471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 40/77] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.429094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.432133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaad89b-84e2-47af-bb0a-a5377a8a18fb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.470970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.471594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.471873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.472173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.472896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:43.473200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.474586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.484205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 38/78] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.484975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.540952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303c75-00d3-4908-ba51-2d76561fa9a5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.550774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.575727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.579298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.579298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.579298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.592383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5203af-7865-44c4-b7e3-f578ae2bbaba None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.593522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.595028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.596749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 41/79] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.597529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.628093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.628761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.629046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.629332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.639644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:43.645311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:43.646173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:43.646940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 39/80] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:43.647567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.669769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.710652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cf03e-a4c0-4bfd-95bd-2ad7cca8a537 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.748563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.749028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.749782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.749782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.750796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.752287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.753904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 42/81] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.755250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.784481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85983334-8a8f-4adc-8c6b-2ee342b1692c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.790594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:43.823819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.824597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.825180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.825652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.862361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe004b-c1fb-4c0e-8e30-95f8e34070fd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:43.900032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:43.900248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.900686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:43.900974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:43.901255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:43.901650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.902493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:43.904490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:43.906120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 43/82] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:43.908767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:43.918218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.006056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 40/83] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.006836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.011724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c9946-09cb-44af-b666-ba077281e7e0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.014012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.047429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.048254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.048544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.048829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.106880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf7741-f3a0-4e13-bf0a-aea785f6d549 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.116583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.118084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.122456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.141896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.142527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.142815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.143376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.143818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:44.144163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.145635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.154711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 41/84] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.155546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.222743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.223626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.226361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.262066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8231c18-f419-4b65-9cb2-d15832aba138 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.297510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.298142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.298425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.298702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.299397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.300925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.324658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f734-a7c8-4d24-a572-500af6f069fe None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.359443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.360101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.360392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.360675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.397494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 42/86] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:57:44 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:44.398405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.435808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.437777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.438249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.440175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.516724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71739862-278f-4df5-a473-68b4f570f742 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.552467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 45/87] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.553452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.563935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.564627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.564912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.565195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.566734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.567936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.569915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 43/88] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.572819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.678366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615decec-8f1d-48a7-9af9-3917ea8c90b8 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.680138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.705539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:44.711861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e618171-2faf-468b-a130-c314fb046289 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.732845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.733504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.733787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.734099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.735885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.737379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.739231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 46/89] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.739821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.753362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.754031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.754319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.754600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.756480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.758455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.761335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 44/90] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.762170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.881353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450f513-0468-4054-88d0-1e67c0f80ba6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.915190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451a8c-aa59-46e8-aa0f-1c39bff9a985 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:44.926441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.927100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.927596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.927722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.928884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.930443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.932327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 47/91] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.933018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.957534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:44.958563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:44.959049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:44.959528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:44.960683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=fece46a4b9f24d8f8750a8912d1377ec) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:44.961224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:44.963057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:44.970323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 45/92] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/role_assignments?user.id=fece46a4b9f24d8f8750a8912d1377ec&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:44.971515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:44.992854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:45.014510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:45.096874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f361c5-1984-49aa-9347-53e7079956c6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:45.138379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:45.138975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:45.139264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:45.139546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:45.140875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645da4d-95b4-450d-8638-03124e00d88c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:45.222414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:45.224009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:45.225232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:45.225871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:45.226152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:45.226427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:45.227228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:45.227541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:45.229038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:45.249699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 46/93] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:45.250565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:45.292363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:45.408389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:45.415038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd56d8-edd0-4478-9970-5887f7f28ce7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:45.458646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:45.459566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:45.459850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:45.460176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:45.461004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:45.461318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:45.461909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 48/94] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:45.462782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:45.467627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:45.469648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 47/95] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:45 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:45.597031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912e619-4334-43dc-a919-b2c24aef6c5e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:45.648729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:45.649414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:45.649699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:45.649980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] PATH_INFO: `/v3/projects/f43c92ec8d0946d3adec68abed045d85` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:45.651270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] RBAC: Authorizing `identity:get_project(project_id=f43c92ec8d0946d3adec68abed045d85)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:45.652871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53053362-145f-47c0-afed-9e35115bf648 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:45.654777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 49/96] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:45 2022] GET /identity/v3/projects/f43c92ec8d0946d3adec68abed045d85 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:45.660568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:45.818465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f049-8d18-4525-b75a-d36e7fb3e1a6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:45.860054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:45.860692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:45.860978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:45.861259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:45.862061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=f43c92ec8d0946d3adec68abed045d85, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:45.862374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:45.863835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543f69-be6c-4987-8230-4ce341b25631 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:45.870238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 48/97] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:45 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=f43c92ec8d0946d3adec68abed045d85&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:47.174407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408348da-9b85-4752-88fc-5ce1a1b15a55 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.174918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408348da-9b85-4752-88fc-5ce1a1b15a55 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.174993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408348da-9b85-4752-88fc-5ce1a1b15a55 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.176353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 50/98] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:47.181656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2d897-e67e-4d40-a35b-e7d29c96435a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.182064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2d897-e67e-4d40-a35b-e7d29c96435a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.182251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2d897-e67e-4d40-a35b-e7d29c96435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.204630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6cd2d897-e67e-4d40-a35b-e7d29c96435a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:47.205850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6cd2d897-e67e-4d40-a35b-e7d29c96435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:47.232928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:47.300374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 49/99] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:47.342051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408348da-9b85-4752-88fc-5ce1a1b15a55 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:47.351074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:47.367359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799088a-40a0-44fa-b203-ea38128e79d4 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.367649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799088a-40a0-44fa-b203-ea38128e79d4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.367942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799088a-40a0-44fa-b203-ea38128e79d4 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.369309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 50/100] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:47.375319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.375635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.375891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.400551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:47.401779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:47.554097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408348da-9b85-4752-88fc-5ce1a1b15a55 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:47.555048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 51/101] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:47.595530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:47.618761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:47.619423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.619712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.620020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.646974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:47.652832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:47.653731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:47.654588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 51/102] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:47.661522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:47.777668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:47.800272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:47.807539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55fe15-b28b-4eed-9582-4778109fdb0a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:47.865915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78820ed-e9fd-4885-8550-d3ac6880efc6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:47.886339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:47.888050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.888575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.889066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.896992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:47.898926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:47.902792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 52/103] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:47.909177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:47.959302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13108083-6199-4504-9589-7a41072364f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:47.960439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108083-6199-4504-9589-7a41072364f7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:47.960943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108083-6199-4504-9589-7a41072364f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:47.961478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108083-6199-4504-9589-7a41072364f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:47.963006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13108083-6199-4504-9589-7a41072364f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:47.964090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13108083-6199-4504-9589-7a41072364f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:47.966470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13108083-6199-4504-9589-7a41072364f7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:47.982736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 52/104] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:47.989446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13108083-6199-4504-9589-7a41072364f7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:48.138512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc3dc-e464-4f52-99d7-35e102f4444c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:48.176600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13108083-6199-4504-9589-7a41072364f7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:48.220009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:48.234991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:48.242458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.242458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.242458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] PATH_INFO: `/v3/users/75f6522fd5194af4a3d3e613f5a0688d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.260664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] RBAC: Authorizing `identity:get_user(user_id=75f6522fd5194af4a3d3e613f5a0688d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:48.262294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:48.264209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 53/105] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:47 2022] GET /identity/v3/users/75f6522fd5194af4a3d3e613f5a0688d => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:48.266489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:48.267145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.267431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.267708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.268433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:48.269927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ada9-e6fe-497d-a82f-55cfc74e9079 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:48.270753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:48.412230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 53/106] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:57:47 2022] POST /identity/v3/projects => generated 302 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:48.413381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f1cc2-311d-455b-8645-79b621e7b3bf None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.413743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f1cc2-311d-455b-8645-79b621e7b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.414023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f1cc2-311d-455b-8645-79b621e7b3bf None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.415402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 54/107] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:48.416210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723c9b-2948-4a46-b78b-d375d5fa80ac None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:48.416516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1678d-5c82-4b72-b59e-493545b8a5ef None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1678d-5c82-4b72-b59e-493545b8a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1678d-5c82-4b72-b59e-493545b8a5ef None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 55/108] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017abd-52d6-4390-a3c1-67df3eb1c7e3 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017abd-52d6-4390-a3c1-67df3eb1c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.421422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3017abd-52d6-4390-a3c1-67df3eb1c7e3 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.422530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 56/109] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:48.425095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f1ed-9aeb-4efe-ae0f-6244199d1438 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.425554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f1ed-9aeb-4efe-ae0f-6244199d1438 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.425934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29f1ed-9aeb-4efe-ae0f-6244199d1438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.435488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:48.448346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8e29f1ed-9aeb-4efe-ae0f-6244199d1438 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:48.449589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8e29f1ed-9aeb-4efe-ae0f-6244199d1438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:48.471135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:48.471784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.472105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.472392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.531460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 57/110] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:48.532952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b2e-e2fc-4219-b2da-56c1e86d98ed None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.533353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b2e-e2fc-4219-b2da-56c1e86d98ed None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.533631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b7b2e-e2fc-4219-b2da-56c1e86d98ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.551088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:48.553698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-eb8b7b2e-e2fc-4219-b2da-56c1e86d98ed None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:48.554922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eb8b7b2e-e2fc-4219-b2da-56c1e86d98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:48.569811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:48.571528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:48.642211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 58/111] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:48.643501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.643806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.652231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.673611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:48.675086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:48.702724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 54/112] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:48.702724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:48.750122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:48.763427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 59/113] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:48.764783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:48.829169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:48.845817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf369ea-7952-46e7-9e3a-aff4dff5a1b7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:48.888690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:48.889331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.890345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.890850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.893356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2d58f-dcfc-47d5-8311-0456964d3f3d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:48.907401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:48.915219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:48.916228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:48.917017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:48.920641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 55/114] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:48.922059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:48.938018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:48.938800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:48.939121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:48.939500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:48.953038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:48.958741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:48.959875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:48.960867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:48.962718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 60/115] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:48.963745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.033120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.067526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aa97f-5193-45ce-b622-8a674aed2462 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.091940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eab5d-b26e-4733-8373-2e6a79d69a9f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.114532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.115183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.115467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.115745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.116974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.118451 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.125613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 56/116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:48 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.125613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.141718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.141919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.142386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.142662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.142943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.154139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-baa9e249-d189-4ac2-840a-c77cdc5e8393 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:49.159185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:49.160107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:49.160915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 61/117] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:57:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:49.162220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459034-c23a-4398-9535-1fc7ca7e4178 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.162220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459034-c23a-4398-9535-1fc7ca7e4178 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.162220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37459034-c23a-4398-9535-1fc7ca7e4178 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.163640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 62/118] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:49.164200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37459034-c23a-4398-9535-1fc7ca7e4178 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.243300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6125a-5d9d-4531-8d08-e8538a8101c9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.281787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.282420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.282709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.282993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.283727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:49.284071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.285501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.294946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 57/119] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.296148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.297072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37459034-c23a-4398-9535-1fc7ca7e4178 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.315378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.337403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.338042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.338331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.338611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.339347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:49.339667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.341447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.350597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 63/120] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.352193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.414191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.439243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c2d14-5a34-4fab-b127-42644d044dc7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.475955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.476601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.476900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.477163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.477982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=75f6522fd5194af4a3d3e613f5a0688d) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:49.478276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.479846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdfc31-d69a-410e-a11c-ff4a9a763e3f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.482517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61e830-800c-470a-ad6a-67bff7873689 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.488654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 58/121] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/role_assignments?user.id=75f6522fd5194af4a3d3e613f5a0688d&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.500418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.500418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.500418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.518218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:49.519578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:49.535454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.536146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.536437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.536718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.537462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:49.537874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.539462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.550466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 64/122] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.551151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.614733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.618609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 59/123] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:49.619418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.712227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.722123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179863-8865-428f-84e6-9659bc1140b3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.750831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8152-0aed-4622-a433-85043fd653cb None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.768779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.769595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.769975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.770380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.771824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.773577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.775702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 65/124] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.776881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.794224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.795726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.796270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.796796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.798409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.800308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.802707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 60/125] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.803981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.911287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebee71-196f-4ce5-b2fa-2ae10e192baa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.922614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:49.951239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a22b-6999-43da-a7b4-6b10098b55da None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:49.968976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.969802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.970400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.970515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:49.971845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:49.973470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:49.975248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 66/126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:49.980784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:49.997848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:49.998747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:49.999483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:49.999965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.010569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.017385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:50.025443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:50.026550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:50.027528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:50.031161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 61/127] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:50.032832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.116474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6cfd1-48ff-4cd3-b865-c0b771df4867 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.153399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.154349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.154757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.155318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.156518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.158152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.158562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf597b5-a39a-481f-9d71-8a27d2b28d1b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.160401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 67/128] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:49 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:50.162107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.205488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.206369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.206821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.207786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.209249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.211793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.212615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.215200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 62/129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:50 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:50.216999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.282536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716880-4c0f-4a09-a73f-e480dc5cf6bd None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.316954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.323135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.323995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.325568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.325568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.326675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.328466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.330367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 68/130] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:50 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:50.336391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.364502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912bd1-6306-4015-b1ec-b5c57496cff3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.412356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.413260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.413692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.414263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.415176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:50.415759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.417391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.427866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 63/131] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:50.429212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.453227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede111-08a4-4e1f-a487-9676535111b9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.464267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.491473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.492114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.492404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.492766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/fece46a4b9f24d8f8750a8912d1377ec/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.494818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, user_id=fece46a4b9f24d8f8750a8912d1377ec, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.496306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.544516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04429e1-7d18-4099-8ad6-5932eb7d6481 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.575856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.579953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 69/132] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:57:50 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/fece46a4b9f24d8f8750a8912d1377ec/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:50.582137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.583317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.584059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.584340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.584622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.586821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, user_id=5ed0dcb8575e454885f5e63e971ac5b7, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.589783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.701576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 64/133] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:57:50 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:50.702916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.769383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa395f38-0384-4939-a0aa-2ca98f231411 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.842905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.845066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.846130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.846745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.853475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, user_id=5ed0dcb8575e454885f5e63e971ac5b7, role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.857290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f73fed-e71b-4d66-bb0f-b54cb2726f35 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.890271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89468d44-8d15-4556-b188-79e6e1ebda1a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:50.930514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:50.931180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.931461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.931738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.932975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:50.935729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15622e9c-eb2f-4208-9bd2-19752911ddd6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:50.937468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 65/134] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:50 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:50.938704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a8ca-320d-49d0-bc3e-7b0cfb85bb4d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.938987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a8ca-320d-49d0-bc3e-7b0cfb85bb4d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.939272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a8ca-320d-49d0-bc3e-7b0cfb85bb4d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.940931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 66/135] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:50.946372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a8ca-320d-49d0-bc3e-7b0cfb85bb4d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:50.946735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 70/136] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:57:50 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:50.954079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:50.954369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:50.954648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:50.985339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:50.986594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:51.023466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:51.040799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:51.093759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a8ca-320d-49d0-bc3e-7b0cfb85bb4d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:51.102142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 71/137] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:51.149440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:51.158178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:51.158842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.159123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.159401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] PATH_INFO: `/v3/projects/f43c92ec8d0946d3adec68abed045d85` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.162383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] RBAC: Authorizing `identity:get_project(project_id=f43c92ec8d0946d3adec68abed045d85)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:51.163874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:51.165957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 67/138] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:50 2022] GET /identity/v3/projects/f43c92ec8d0946d3adec68abed045d85 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:51.172769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:51.280787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e155f-2d44-4162-86b2-6f8c74677ddd None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:51.330770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:51.331559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.331716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.331994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.333453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:51.336806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:51.338285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 72/139] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:51.347524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:51.405897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb55a8-4ef4-46f0-bf8f-09e5acf80797 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:51.407362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:51.437422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:51.459702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163713-a249-454b-854c-28e5bb52941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:51.460419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163713-a249-454b-854c-28e5bb52941b None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.460703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163713-a249-454b-854c-28e5bb52941b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.460978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163713-a249-454b-854c-28e5bb52941b None admin] PATH_INFO: `/v3/projects/f43c92ec8d0946d3adec68abed045d85/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.463727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163713-a249-454b-854c-28e5bb52941b None admin] RBAC: Authorizing `identity:create_grant(project_id=f43c92ec8d0946d3adec68abed045d85, user_id=5ed0dcb8575e454885f5e63e971ac5b7, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:51.467020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163713-a249-454b-854c-28e5bb52941b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:51.524682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f1f-b05a-4817-84da-4940884bdde7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:51.546534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 68/140] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:57:51 2022] PUT /identity/v3/projects/f43c92ec8d0946d3adec68abed045d85/users/5ed0dcb8575e454885f5e63e971ac5b7/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:51.585031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:51.585727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.586012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.586287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.586976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:51.588470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6872d-1d43-400e-be98-b19fbe93d522 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:51.690909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 73/141] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:57:51 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:51.939176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a889-bfc0-41f9-99db-8e671690727d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.939537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a889-bfc0-41f9-99db-8e671690727d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.939740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a889-bfc0-41f9-99db-8e671690727d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.941191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 69/142] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:51.946973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:51.947538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:51.948102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:51.968637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:51.970175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:52.053882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 74/143] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:52.090532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a889-bfc0-41f9-99db-8e671690727d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:52.226567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a889-bfc0-41f9-99db-8e671690727d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:52.275593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:52.276348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:52.276641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:52.276921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:52.293640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:52.299340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:52.300339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:52.301109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 70/144] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:52.308528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:52.335294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:52.440248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb13bb-a5b8-4a21-a760-7d1e33875b2a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:52.475822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:52.476484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:52.476824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:52.477054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:52.477786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:52.478098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:52.479495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:52.488774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 75/145] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:52.494510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:52.550091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:52.610137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a235b2-962d-4e24-95c0-29a64eb7a5bd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:52.645455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:52.646108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:52.646397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:52.646680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] PATH_INFO: `/v3/users/75f6522fd5194af4a3d3e613f5a0688d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:52.647893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] RBAC: Authorizing `identity:get_user(user_id=75f6522fd5194af4a3d3e613f5a0688d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:52.649461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:52.651129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 71/146] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:52 2022] GET /identity/v3/users/75f6522fd5194af4a3d3e613f5a0688d => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:52.657337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:52.761028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:52.774333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223341e0-dde6-4eef-a5c1-94764e71f8b7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:52.821075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:52.821761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:52.822048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:52.822410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:52.828961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:52.830485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58a9b-3a4d-4b2c-8808-17c564ddfba5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:52.832756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 76/147] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:52 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:52.838453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:52.962038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400da27-d725-4754-b24c-8911395fa41c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:52.979427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:53.004807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:53.007935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.007935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.007935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/75f6522fd5194af4a3d3e613f5a0688d/roles/52256f78efcb4eeb8e635a9e21f0f6ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.013556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, user_id=75f6522fd5194af4a3d3e613f5a0688d, role_id=52256f78efcb4eeb8e635a9e21f0f6ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:53.015109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0548c0c-7fc6-44a0-be1d-4095850241fa None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:53.118006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 72/148] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:57:52 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/users/75f6522fd5194af4a3d3e613f5a0688d/roles/52256f78efcb4eeb8e635a9e21f0f6ca => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:57:53.369665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a011e-d2f7-4ff9-b981-80045f7dcaa7 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.370176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a011e-d2f7-4ff9-b981-80045f7dcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.370250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a011e-d2f7-4ff9-b981-80045f7dcaa7 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.371863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 77/149] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:53.378561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc03-f2b9-4e87-8404-1d0d154bcc58 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.379263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc03-f2b9-4e87-8404-1d0d154bcc58 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.379759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc03-f2b9-4e87-8404-1d0d154bcc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.400242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3f48fc03-f2b9-4e87-8404-1d0d154bcc58 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:53.401843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f48fc03-f2b9-4e87-8404-1d0d154bcc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:53.477256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 73/150] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:53.514593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a011e-d2f7-4ff9-b981-80045f7dcaa7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:53.637393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a011e-d2f7-4ff9-b981-80045f7dcaa7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:53.679828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:53.683939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.683939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.683939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.684214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc67f-981e-4fc1-b93c-98fe1465dbb5 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.684214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc67f-981e-4fc1-b93c-98fe1465dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.684214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc67f-981e-4fc1-b93c-98fe1465dbb5 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.685174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 74/151] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:57:53.689446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:53.689966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:53.690624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:53.708618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:53.714361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:53.715756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:53.716600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 78/152] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:53.733026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:53.744132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:53.750207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:53.759706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:53.942619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 75/153] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:53.970778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9648b-624a-46ba-9952-f1b4bec4944c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:53.993536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:54.025004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:54.026173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:54.026661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:54.027135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:54.028676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:54.029188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:54.035928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:54.054603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 79/154] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:54.061336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:54.077019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:54.179223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:54.234230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a62a-12c0-4d89-aa7d-08dd8fdb0926 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:54.244420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3c4a-0d27-42f9-b557-9fdb6b2849a8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:54.305830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:54.306502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:54.306793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:54.307179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] PATH_INFO: `/v3/users/fece46a4b9f24d8f8750a8912d1377ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:54.308609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=fece46a4b9f24d8f8750a8912d1377ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:54.309975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:54.310719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:54.311215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:54.311694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:54.312197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:54.312405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 80/155] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:54 2022] GET /identity/v3/users/fece46a4b9f24d8f8750a8912d1377ec => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:54.319476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:54.348577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:54.354224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:54.355068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:54.355954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:54.358388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 76/156] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:57:54.364143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:54.516098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea615b5-21f6-4c4f-bd65-24e76260e3d7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:54.544926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:54.561988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c3c15-78be-4147-a3db-3095bd8564ee None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:54.574124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:54.576135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:54.577571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:54.578077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:54.588435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:54.643533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:54.648662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:54.649207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:54.649686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:54.650633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:54.651209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:54.654250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:54.683171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 77/157] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:54.692957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:54.747941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:54.748339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:54.925974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866464c-e843-4570-b334-057cfa2f8064 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:54.932674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 81/158] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:54.943955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.004997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.006092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:55.007009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.007499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.008003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.009588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:55.011294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:55.013785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 78/159] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:54 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:55.019504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.066705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.131949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19dd74-b71b-43e2-994c-d14e5d384753 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:55.186557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:55.187141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.187426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.187707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.190464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:55.191985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:55.194049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 82/160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:54 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:55.200845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.243972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df3e4c-b3df-474b-9fb8-c25233801dae None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:55.331627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8c121-52c4-4ae0-b046-1ce095b467a5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:55.332740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:55.333613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.334096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.334571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.340710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.394207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:55.394856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.395141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.395422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.396266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=fece46a4b9f24d8f8750a8912d1377ec) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:55.396584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:55.398065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d5f17-90c4-4f71-8c5f-055578c4e61b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:55.414095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 83/161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:55 2022] GET /identity/v3/role_assignments?user.id=fece46a4b9f24d8f8750a8912d1377ec&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:55.415537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa90a9-4f2b-45e3-9777-38d35352b42f None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.415828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa90a9-4f2b-45e3-9777-38d35352b42f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.416156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa90a9-4f2b-45e3-9777-38d35352b42f None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.416383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:55.418097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:55.423269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 84/162] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:55.424259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746eb54-9c66-4eb3-a3fe-9e74d6335144 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.424549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746eb54-9c66-4eb3-a3fe-9e74d6335144 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.424831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746eb54-9c66-4eb3-a3fe-9e74d6335144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.449074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.463999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1746eb54-9c66-4eb3-a3fe-9e74d6335144 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:55.465295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1746eb54-9c66-4eb3-a3fe-9e74d6335144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:55.539844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 79/163] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:55.546313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.594173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 85/164] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:55.596672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b111d5-fb68-4b11-9b36-e3ac7a7efb9d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.597158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b111d5-fb68-4b11-9b36-e3ac7a7efb9d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.597675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b111d5-fb68-4b11-9b36-e3ac7a7efb9d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.599238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 86/165] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:55.609706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.610303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.610742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.651259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:55.656236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:55.672809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0f68-b4ea-4df9-8e9c-0b6644738855 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:55.700240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.720861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:55.721979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:55.722463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:55.722945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:55.725291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:55.727049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:55.730062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 80/166] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:55 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:55.733367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.827995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 87/167] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:57:55.829228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:55.878849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.974027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb44fd-96ab-4041-8393-f6b3fb2912fd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:55.975522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de52de-78c6-4f7b-b3ca-8da2e227ff4a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.023940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.023940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.023940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.023940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.024338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:56.024338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.024810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:56.032186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 88/168] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:55 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:56.032878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.050506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.051632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.052174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.052649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.066878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:56.073863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:56.075680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:56.076527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:56.079585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 81/169] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:57:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:56.085247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.172235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.186462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6ca06-d820-4130-a51f-e3651318c2b7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.197202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.239803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.240440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.240727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.241008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.261739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:56.267468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:56.268459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:57:56.269250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:56.272899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 89/170] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:56.280139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.319932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964514c2-79cf-4244-ab51-4ac517f30409 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.399131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.400210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.400700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.401193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.402122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:56.403219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.405050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:56.416178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 82/171] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:57:56.422586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.436390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f09f-52c2-4d81-927a-461103f109eb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.473616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.474628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.475113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.475588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.476542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:56.477057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.478669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:56.487697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 90/172] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:56.509418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.543936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.585685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de5a9-329b-44dd-9f27-4812e080c231 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.607680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.640359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.641020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.641310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.641587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.648799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.650320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:56.652295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 83/173] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:56.657889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.741343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f114e-8d9c-4f70-a491-05f03200b9bf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.801283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.804166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.804755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.805239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] PATH_INFO: `/v3/users/5ed0dcb8575e454885f5e63e971ac5b7` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.806764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] RBAC: Authorizing `identity:get_user(user_id=5ed0dcb8575e454885f5e63e971ac5b7)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.809624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f44ab-5e3c-4f3c-9629-53d863dd983f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:56.811594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 91/174] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/users/5ed0dcb8575e454885f5e63e971ac5b7 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:56.813223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c7d1-59b8-4540-a899-1f6fba601037 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.813726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c7d1-59b8-4540-a899-1f6fba601037 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.814205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89c7d1-59b8-4540-a899-1f6fba601037 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.815828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 92/175] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:56.818457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89c7d1-59b8-4540-a899-1f6fba601037 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:56.845712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fa0ba-e47e-4bd7-b8af-01ea9bffac11 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:56.893799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:56.894433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:56.894714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:56.894976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:56.950643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.968430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.988405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:56.989874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80ac4-7dcb-4467-a07b-c46484a9214a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:57.004642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89c7d1-59b8-4540-a899-1f6fba601037 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:57.099754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 84/176] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:57.101714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.102067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.102441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.123755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:57.125141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:57.136652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:57.137874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.138163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.138448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.202400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 85/177] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:57.203615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.229830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:57.298294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:57.299819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516753-45d8-49a9-adc2-39dc857e33de None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:57.357560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb32b-4a90-420a-b8a7-dc8870652580 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:57.400692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:57.406700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:57.407355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.407639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.407938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.409208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:57.410681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6261970-ee1e-492e-a4cc-3cb7748a2cc0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:57.412411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 86/178] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:57.413593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606778-78dd-4fe0-857e-1026e7754a82 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.413877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606778-78dd-4fe0-857e-1026e7754a82 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.414158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606778-78dd-4fe0-857e-1026e7754a82 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.417552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 87/179] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:57.418111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606778-78dd-4fe0-857e-1026e7754a82 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.422953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 93/180] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:57.425465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511259c6-5db3-4caf-98d7-30d0ac248443 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.425953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511259c6-5db3-4caf-98d7-30d0ac248443 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.426495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511259c6-5db3-4caf-98d7-30d0ac248443 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.432419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 94/181] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:57.435186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa4ca-113f-45b5-9b99-37d1480f64e1 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.436338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa4ca-113f-45b5-9b99-37d1480f64e1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.436622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa4ca-113f-45b5-9b99-37d1480f64e1 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.439328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 95/182] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:57:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:57:57.440462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fa4ca-113f-45b5-9b99-37d1480f64e1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.517802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:57.546123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606778-78dd-4fe0-857e-1026e7754a82 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:57.562630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fa4ca-113f-45b5-9b99-37d1480f64e1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:57.584104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:57.584886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.585145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.585424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.598705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:57.599199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:57.599829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.600161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.600421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.601236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:57.601548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:57.603012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-9a92778c-a46e-4260-a763-e80e8692513c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:57.603745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:57.604601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:57:57.605386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 88/183] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:57.606946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97983559-7563-4592-8b84-277200065074 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.607440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97983559-7563-4592-8b84-277200065074 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.607780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97983559-7563-4592-8b84-277200065074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.613094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 96/184] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:57.614047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.635484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-97983559-7563-4592-8b84-277200065074 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:57.636777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-97983559-7563-4592-8b84-277200065074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:57.682250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:57.738799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 89/185] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:57.740569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.741055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.741343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.766261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:57.767181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:57.774125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac536a0a-1169-43d2-b413-f8fa2dcb5781 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:57.826872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:57.828458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.829142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.829424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] PATH_INFO: `/v3/projects/f43c92ec8d0946d3adec68abed045d85` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.830716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] RBAC: Authorizing `identity:get_project(project_id=f43c92ec8d0946d3adec68abed045d85)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:57.832266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9aeaa-26f7-4478-b906-920d044c8778 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:57.834614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 97/186] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/projects/f43c92ec8d0946d3adec68abed045d85 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:57.835250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:57.835524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:57.835809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:57.854274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:57.859283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:57:57.859283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:57:57.861740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 90/187] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:57.862669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.949149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 98/188] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:57.951285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:57.991244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0f94-e69d-4065-a8f4-8ac92e93d201 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.005454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.031693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.032761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.032761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.033029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.033765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:58.034075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.035597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.045698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 91/189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.046717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.073709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcbca0-bd08-4aa7-9abc-515bf0258302 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.118497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.119150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.119344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.119462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.119682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.130997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:58.136381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:58.138267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 99/190] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:58.139165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.169818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b7d4d-8049-433b-9eba-7d0da6f05135 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.205323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.205944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.206232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.206502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.207302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=f43c92ec8d0946d3adec68abed045d85, user.id=5ed0dcb8575e454885f5e63e971ac5b7) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:58.207612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.209235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.215679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 92/191] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/role_assignments?user.id=5ed0dcb8575e454885f5e63e971ac5b7&scope.project.id=f43c92ec8d0946d3adec68abed045d85&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.224893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.256450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d90a0-4c30-41ff-97d0-41129b36e3c9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.258737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.296848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.297533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.297810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.298078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.311114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:57:58.316770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:57:58.322128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 100/192] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:57:58.323107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.358938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244e3e8-bd38-4d00-96ef-ba7f1760a48e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.433438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.445383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083e200-534f-492c-9598-1f86cd04a44b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.448655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.457689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 93/193] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.458119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.486409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.487057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.487344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.487621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.501461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.502953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.504693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 101/194] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.505583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.528686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.569593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3378-48bd-42c3-b49d-34e7357450db None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.604414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.605031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.605306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.605604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.606894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:58.607199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.607311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecdeaa-fdc9-4356-aa36-1ae54d6b1420 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.608619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.616852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 94/195] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.617648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.643151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.643792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.644084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.644363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.645080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:58.645383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.646775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.655786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 102/196] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:58.656660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.677257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.724727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52df7e-cc9e-4940-a43f-2efb25ee6c09 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.742290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.757655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.758279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.758559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.758831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.759519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.759985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9db28-f9a5-45ae-ba95-b5492eb4fbd0 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.761140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.796231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:58.796863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:58.797142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:58.797415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:58.842727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 95/197] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:57:58 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:57:58.843821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:58.883729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:58.885820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:58.961623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e43e6-3635-42ff-80be-235a4debd86a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:58.974728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:58.980797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.000917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.001580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.001896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.002150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.005063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 103/198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.005063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.009254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.014267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.014267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 96/199] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:58 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:59.018512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.140808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8c055-f161-4b5f-8a81-bc28933431cb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.144435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202a366-12d9-448f-b2c8-11094574fa1a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.182217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.182886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.183133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.183408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] PATH_INFO: `/v3/users/75f6522fd5194af4a3d3e613f5a0688d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.184944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] RBAC: Authorizing `identity:get_user(user_id=75f6522fd5194af4a3d3e613f5a0688d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.186416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.186669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.187323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.187601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.187872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.188053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 104/200] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/users/75f6522fd5194af4a3d3e613f5a0688d => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:59.188820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.189393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.190855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.194247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 97/201] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:59.194602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.250192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.251781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.307825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faffa4b-4d27-40ef-a16a-64be0540cc02 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.312233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44622aee-9689-47c3-913b-b436c23e59ca None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.350326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.351068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.351363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.351639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.358466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.359323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.359776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.362739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.439855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.442410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.448871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.450924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.502328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.506673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.566934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 98/202] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.568121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.580760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 105/203] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.580760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.696818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330368-d530-414e-9c64-c621f40fd26e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.710476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3edf6-1af8-49ba-9cb2-7e18dc6987ef None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.739104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.739533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.739891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.740268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.741553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.743328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.745162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 106/204] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:59.746860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.757854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.758758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.759222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.760086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.761094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=6233601cc710447c9dfe540205681493, user.id=1be900b5ff1e46dfaf95005b4d4a0f1e) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:59.761920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.763846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.768762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.771919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 99/205] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/role_assignments?user.id=1be900b5ff1e46dfaf95005b4d4a0f1e&scope.project.id=6233601cc710447c9dfe540205681493&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:57:59.773509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:57:59.790115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:59.915673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8390-b569-43f1-bf3a-c9530c2f2dd8 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.963628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:57:59.965073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:57:59.965526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:57:59.965742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a36c-5f62-43ef-ab54-6d345bbfbd04 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:57:59.966370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:57:59.967324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d, user.id=75f6522fd5194af4a3d3e613f5a0688d) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:57:59.967784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:57:59.969429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:57:59.990290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 100/206] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/role_assignments?user.id=75f6522fd5194af4a3d3e613f5a0688d&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:00.009276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:00.010055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:00.010414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:00.010767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:00.012782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:00.014746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a39e1-fc1e-42e2-9e82-fd81dfa5fb71 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:00.016600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 107/207] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:57:59 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:00.022861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:00.112223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:00.139751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47740-532c-4ccb-b684-c8c2e233cd35 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:00.190301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:00.190941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:00.191224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:00.191501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:00.192414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=6233601cc710447c9dfe540205681493, user.id=1be900b5ff1e46dfaf95005b4d4a0f1e) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:00.192729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:00.194206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daab6b-1674-4b1d-976f-f6d4d2b78029 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:00.201403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 101/208] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:00 2022] GET /identity/v3/role_assignments?user.id=1be900b5ff1e46dfaf95005b4d4a0f1e&scope.project.id=6233601cc710447c9dfe540205681493&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:01.138676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359ba7-1ce7-4698-a207-79105be9dada None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.139196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359ba7-1ce7-4698-a207-79105be9dada None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.139273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359ba7-1ce7-4698-a207-79105be9dada None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.140892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 108/209] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:01.150780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22801c2-b8c6-46ca-811d-0a5ed4fa50f6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.151279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.151360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22801c2-b8c6-46ca-811d-0a5ed4fa50f6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.151430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.151506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22801c2-b8c6-46ca-811d-0a5ed4fa50f6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.151575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.153831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 102/210] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:01.158723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.159007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.159282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.172604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:01.173816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:01.178748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:01.180129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:01.249710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 109/211] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:01.261968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 103/212] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:01.273310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.286483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.293513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.358233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.399962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9ac2-a364-4507-8f20-634425df94a9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:01.426781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d29d-06d7-4a81-a068-31e777db8ede None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:01.439448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:01.440155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.440437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.440715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.441992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:01.443621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:01.445472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 104/213] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:01.451896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.468243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:01.468904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.469187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.469465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.482618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:01.487655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:01.488577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:01.489368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 110/214] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:01.494501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.583091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.588829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed22c-77e3-4610-b1a8-b433655a4f8b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:01.608085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24f864-c502-45d2-8296-199abcf3461c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:01.646153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:01.646679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.646967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.647246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.648036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:01.648348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:01.649817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:01.655263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:01.658046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.658540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.659036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.659667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 111/215] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:01.660448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:01.662161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:01.665006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.672800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.759097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 105/216] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:01 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:58:01.806156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00decc5-8cf9-4c9c-b1eb-885e90f0dcfd None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:01.846502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:01.847205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:01.847492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:01.847769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] PATH_INFO: `/v3/users/937e8f547f1a446e9b23f56514a78a3a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:01.856813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.865463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] RBAC: Authorizing `identity:get_user(user_id=937e8f547f1a446e9b23f56514a78a3a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:01.867028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcbb02-7ca3-4cef-93d3-ffba8fe721ce None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:01.868965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 112/217] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:01 2022] GET /identity/v3/users/937e8f547f1a446e9b23f56514a78a3a => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:01.875534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:01.994201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76193aa7-f275-4502-bc28-65edd2b894b7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.031470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.032193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.032472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.032761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.098661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:02.109812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:02.111347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:02.151596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0151-8db4-4595-8b50-b2185d0cc877 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.152687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0151-8db4-4595-8b50-b2185d0cc877 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.153166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0151-8db4-4595-8b50-b2185d0cc877 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.154753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 113/218] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:02.161620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.162265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.162769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.185299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:02.186906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:02.260027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 106/219] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:02.263478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.293615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:02.316639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.381148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:02.392833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40ce7a-a1af-47ee-845b-35dad7000aba None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.431148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.432276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.433104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.433385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.434668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:02.436178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7aca1-ed6d-4a8b-a541-b9dc303fb210 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:02.442726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 107/221] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:02.442726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8af8-6b01-454f-94cb-97ea42fbb641 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.442726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8af8-6b01-454f-94cb-97ea42fbb641 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.442726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f8af8-6b01-454f-94cb-97ea42fbb641 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.442726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 108/222] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:02.444820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8af8-6b01-454f-94cb-97ea42fbb641 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.498542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e330-19e2-4541-834e-43f9286a9752 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.529332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:02.538748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.539764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.540245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.545733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.553618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-cf6f37d2-8b81-4e68-aadc-e5ce0d4efedb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:02.559457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:02.560400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:02.561249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 115/223] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:02.566884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.567760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.568003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.588144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:02.589576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:02.593023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f8af8-6b01-454f-94cb-97ea42fbb641 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.645657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.646620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.647083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.647589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.648636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=6233601cc710447c9dfe540205681493, user.id=937e8f547f1a446e9b23f56514a78a3a) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:02.649132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:02.650810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:02.657729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 109/224] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/role_assignments?user.id=937e8f547f1a446e9b23f56514a78a3a&scope.project.id=6233601cc710447c9dfe540205681493&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:02.658820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.691019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 116/225] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:02.712354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:02.726727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.818800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689c0f-67c5-4e2b-b884-fa1ec38015c5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.858100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.858749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.859036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.859318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:02.860123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:02.860434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:02.861886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:02.872612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 110/226] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:02.881050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:02.922157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10085d-6966-456e-95a5-2105bbf98641 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:02.947779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:02.982616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:02.983575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:02.984031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:02.984454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.011663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:03.015286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:03.022132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:03.026966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:03.028661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 117/227] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:03.031831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.041632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7ec98-bbb1-4e5c-b112-78f724f4843d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.117765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.118441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.118719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.118992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.120667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.122252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.124352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 111/228] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:02 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:03.129945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.177502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723751-bc6a-42d7-8abe-6eca0d4ee1c5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.228702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.229350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.229710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.229993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.231503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:03.231816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.233421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.252967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 118/229] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:03.264997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.282084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55518-66b6-45fc-bf00-00a3742e060c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.320176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.320832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.321110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.321383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.329362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.329362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.329362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 112/230] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:03 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:03.336298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.349557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:03.383994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:03.410947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd1180-5dea-4f04-b155-b7a22d7f5d22 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.449761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c15c-d879-4b8d-83af-36d1c2d04a04 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.493011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.493951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.494229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.494973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/users/1be900b5ff1e46dfaf95005b4d4a0f1e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.497401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, user_id=1be900b5ff1e46dfaf95005b4d4a0f1e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.498876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.529257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.529934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.530215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.530494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.531896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.533534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.535757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 119/231] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:03 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:03.545369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.581090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 113/232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:03 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/users/1be900b5ff1e46dfaf95005b4d4a0f1e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:03.724264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed6c9-41cb-455d-98d5-47541ea88ef5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:03.738638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:03.777138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:03.778194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:03.778625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:03.779048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:03.780495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:03.782213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872a2fb-381e-4f40-b2b3-9ec2aebb4b7b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:03.784232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 120/233] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:03 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:03.790326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:03.939509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:03.964263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324cd66-1954-4f3e-aa0a-9c81ab8e5ef9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:04.006234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:04.007045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.007324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.007639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/users/1be900b5ff1e46dfaf95005b4d4a0f1e/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.009960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, user_id=1be900b5ff1e46dfaf95005b4d4a0f1e, role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:04.011428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae756536-8844-4175-a539-ad189ec5a660 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:04.106505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 114/234] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:03 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/users/1be900b5ff1e46dfaf95005b4d4a0f1e/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:04.498638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e360f-917e-428a-8eb9-940c52bc1d54 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.499155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e360f-917e-428a-8eb9-940c52bc1d54 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.499230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e360f-917e-428a-8eb9-940c52bc1d54 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.500598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 121/235] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:04.506861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.507346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.507421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.533046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:04.534464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:04.581305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d818-7c98-47f4-bfd7-ddac98af6113 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.581747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d818-7c98-47f4-bfd7-ddac98af6113 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.582133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d818-7c98-47f4-bfd7-ddac98af6113 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.586093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 122/236] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:04.590799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.591408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.591767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.618237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:04.619583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:04.634155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 115/237] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:04.714467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 123/238] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:04.728019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:04.740643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:04.845611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a60e0-4b1e-4a0b-8074-d3ada4e595cb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:04.856442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:04.874268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:04.913266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:04.913918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:04.914200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:04.914474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:04.933930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5928-8328-41f2-ba6f-d0467c5be206 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:04.936022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:04.941153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:04.942057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:04.942848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:04.943477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 124/239] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:04.951021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.007313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.009491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.010901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.011385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.013728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.017661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.032242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 116/240] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:05.038963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.114574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fc3d-b07b-42f4-a728-e21959edd679 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.150917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.151622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.151924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.152186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.152981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:05.153287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.154677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246cb7d-57e6-4179-bbab-332ce90cd6ff None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.163773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 125/241] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:05.168561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aa1bb-7f3e-4f1b-bd47-1b3e5524bf15 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.168561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aa1bb-7f3e-4f1b-bd47-1b3e5524bf15 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.168561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aa1bb-7f3e-4f1b-bd47-1b3e5524bf15 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.168561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 126/242] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:05.172837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.173121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.173400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.193122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:05.194411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:05.198289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad82ebe-4c6e-4624-92d8-e940320114a9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.217347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.246950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.248124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.248637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.249456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.250634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.252794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.267059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.270842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 127/243] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:05.271524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.378167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbbcb-6f63-4fee-b2ea-bb9c0916ae5d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.388647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 117/244] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:05 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:58:05.389962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.433008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.434327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.434608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.434887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] PATH_INFO: `/v3/users/e9325ec36bf3429bb404096587095de0` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.457775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] RBAC: Authorizing `identity:get_user(user_id=e9325ec36bf3429bb404096587095de0)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.463273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.463273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 128/245] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/users/e9325ec36bf3429bb404096587095de0 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:05.471474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.505880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.609573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86e43-a990-4c71-a32d-3e020e94754d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.636038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2b0b6-63d3-4379-a822-5e793c952d1c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.650882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.651822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.652968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.653797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.673489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.674622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.675091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.675684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.687891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:05.693990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:05.694893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:05.695702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:05.705817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 118/246] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:05.711616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.739129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.741250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.758157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.775934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:05.824817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a8f2-4152-4cb3-8b17-14b700ea03cd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:05.850785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 129/247] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:05.856539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.868083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:05.868902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:05.869597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:05.869982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:05.871662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:05.872132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:05.873851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:05.889060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 119/248] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:05.895177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:05.995752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201bc00-461c-440f-ba84-adc7270ce7dd None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.007736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba707c78-88ae-413b-88d3-b671e927a6e0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.013086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:06.028247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:06.036201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.036856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.037142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.037410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.038690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:06.040217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:06.041876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 130/249] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:06.048372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.050787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.051666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.052144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.052591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] PATH_INFO: `/v3/users/937e8f547f1a446e9b23f56514a78a3a` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.055414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] RBAC: Authorizing `identity:get_user(user_id=937e8f547f1a446e9b23f56514a78a3a)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:06.055721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:06.057825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 120/250] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:05 2022] GET /identity/v3/users/937e8f547f1a446e9b23f56514a78a3a => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:06.063586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.167425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213b22-aaf3-422a-b6c8-b8a6509ea95c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.197451 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92caff8-0503-4b74-be8d-1f8f86bb29f3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.224405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.225654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.226472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.227479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.228813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, scope.project.id=6233601cc710447c9dfe540205681493, user.id=e9325ec36bf3429bb404096587095de0) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:06.229626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:06.233107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e76fd-8e5b-428a-a50f-2a36f5d5be26 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:06.240817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 131/251] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:06 2022] GET /identity/v3/role_assignments?user.id=e9325ec36bf3429bb404096587095de0&scope.project.id=6233601cc710447c9dfe540205681493&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:06.240973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.241617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.241904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.242182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.243447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a410-54ad-46e5-9129-d732baba0995 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.243970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a410-54ad-46e5-9129-d732baba0995 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.244468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a410-54ad-46e5-9129-d732baba0995 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.244808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:06.246888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:06.247323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 132/252] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:06.251282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 121/253] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:06 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:06.252984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.253285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.253547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.254615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.280071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:06.281303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:06.325186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:06.340724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:06.376261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161ee5-1cdb-45e8-9045-87858dddec25 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.381409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 133/254] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:06.425864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.577689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.578384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.578668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.578945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/users/937e8f547f1a446e9b23f56514a78a3a/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.585377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, user_id=937e8f547f1a446e9b23f56514a78a3a, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:06.586948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:06.599653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04be9cf-f395-467d-9d4d-54275e59e365 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.653342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:06.654085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.654364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.654630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.665498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-00fb2a7b-bdc4-44f9-a615-3488b2443ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:06.671471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:06.672414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:06.673606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 134/255] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:06.674268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387a4c-9002-4ff3-8064-359224a7e66e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.674547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387a4c-9002-4ff3-8064-359224a7e66e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.675472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387a4c-9002-4ff3-8064-359224a7e66e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.676401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 135/256] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:06.681824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:06.682202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:06.682481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:06.688261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 122/257] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:06 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/users/937e8f547f1a446e9b23f56514a78a3a/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:58:06.689098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.706241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:06.707971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:06.774945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:06.874783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 136/258] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:06.908663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:06.943570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0489349-58f4-4334-8d85-4db64b800e7a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:06.977804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.010303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.011044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.011330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.012162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.012915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:07.013224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.015105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.025633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 123/259] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:07.032083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.064259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14cb83-1a47-441b-84f8-5a90b1e8c8af None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.099648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.100365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.100649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.100926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.112265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:07.117735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:07.118611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:07.119856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 137/260] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:07.125521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.160583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.214273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bba0-5f73-472c-a6ab-c8565e4dc494 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.236928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bceb91-4bfc-465b-bfb5-873d8519ddf5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.274210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.274843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.275127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.275407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.276176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:07.276472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.278550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.287521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 138/261] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:07.293677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.303584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.304336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.304623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.304896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.306476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.308094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.310622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 124/262] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:07.317526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.390243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.399134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.403547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af28a-e9bd-4a9e-bce5-9737ff8397fb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.452526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.453185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.453469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.453743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] PATH_INFO: `/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.455754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] RBAC: Authorizing `identity:get_user(user_id=1be900b5ff1e46dfaf95005b4d4a0f1e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.458000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.459824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 139/263] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/users/1be900b5ff1e46dfaf95005b4d4a0f1e => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:07.465441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.469368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d8c42-688a-44ee-b728-70a968d6dd4d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.507503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.508504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.508990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.509464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.584555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.586758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.604371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284dd8c-2534-4522-b84a-1161171c4658 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:07.646542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:07.647175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:07.652118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:07.652118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:07.696815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.702075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.781137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:07.782558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:07.811464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 125/264] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:07.817122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.908780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 140/265] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:07.914407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:07.988138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:08.059260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8abe20-a8dc-4067-8cb4-b205e2ecfaf0 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:08.090696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f7b0e-7dc1-46f1-87f8-31905670c0ec None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:08.134938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:08.135600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.135885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.136198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.139132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:08.140649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:08.142353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 141/266] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:08.151143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:08.172097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:08.172761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.173044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.173318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.174558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:08.176076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:08.178731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 126/267] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:07 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:08.185146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:08.215778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:08.385926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743519df-15b2-4923-be19-8815bb15f37b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:08.440371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:08.453472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e408d-8bc9-4c10-9ebf-f092203cda08 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:08.460787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:08.461427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.461711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.468005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.468005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=6233601cc710447c9dfe540205681493, user.id=1be900b5ff1e46dfaf95005b4d4a0f1e) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:08.468005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:08.468005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe340603-c9b3-4e1e-9304-574defe09be7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:08.479743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 142/268] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:08 2022] GET /identity/v3/role_assignments?user.id=1be900b5ff1e46dfaf95005b4d4a0f1e&scope.project.id=6233601cc710447c9dfe540205681493&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:08.515854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:08.516514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.516796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.517072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.517886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=6233601cc710447c9dfe540205681493, user.id=1be900b5ff1e46dfaf95005b4d4a0f1e) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:08.518200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:08.519659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214d523-05b2-47e1-b226-105371a0d9d5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:08.528282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 127/269] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:08 2022] GET /identity/v3/role_assignments?user.id=1be900b5ff1e46dfaf95005b4d4a0f1e&scope.project.id=6233601cc710447c9dfe540205681493&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:08.835416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c818-0962-42af-b558-1db3dd97be3d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.836473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c818-0962-42af-b558-1db3dd97be3d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.836978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c818-0962-42af-b558-1db3dd97be3d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.838895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 143/270] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:08.844707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f18-369d-4368-bf5c-093d10975a7c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:08.845169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f18-369d-4368-bf5c-093d10975a7c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:08.845265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807f18-369d-4368-bf5c-093d10975a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:08.869157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d8807f18-369d-4368-bf5c-093d10975a7c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:08.870386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d8807f18-369d-4368-bf5c-093d10975a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:08.963886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 128/271] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:08.992437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c818-0962-42af-b558-1db3dd97be3d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.132902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c818-0962-42af-b558-1db3dd97be3d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.151778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39696e-2a8d-4180-b0bf-a4ce004dbc8f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.152179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39696e-2a8d-4180-b0bf-a4ce004dbc8f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.152499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39696e-2a8d-4180-b0bf-a4ce004dbc8f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.154119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 129/272] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:09.160199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b179a2-be19-413d-acce-b9481f8438f7 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.160495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b179a2-be19-413d-acce-b9481f8438f7 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.160774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b179a2-be19-413d-acce-b9481f8438f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.174808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.180537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.181251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-45b179a2-be19-413d-acce-b9481f8438f7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:09.181746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.182227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.182459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-45b179a2-be19-413d-acce-b9481f8438f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:09.182905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.184495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:09.186170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:09.190092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 144/273] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:09.196039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.256581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 130/274] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:09.257777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ef84-dcad-4da1-bc7d-491137a9bcc5 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.258067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ef84-dcad-4da1-bc7d-491137a9bcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.258345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ef84-dcad-4da1-bc7d-491137a9bcc5 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.259603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 131/275] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:09.265821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.266114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.266392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.269713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.287034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:09.288274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:09.315530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d383493-1745-45cf-a592-f8413deec5da None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.351528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.352175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.352464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.352788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.353519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:09.354993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:09.360789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 132/276] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:09.364966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.436588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.440323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 145/277] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:09 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:09.441441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.501255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ce5f-4394-49d8-bd0b-c84bc1c8e3e4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.553545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.554141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.554426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.554703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.570117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:09.577975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:09.578977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:09.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 133/278] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:09.586025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d474-d097-41b0-b2ab-d3a407d7a1e7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.586106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.604214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.633896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.634557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.634842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.635111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.650323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:09.657678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:09.658684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:09.659524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 146/279] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:09.668810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.719692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d58bf-b1b8-43bf-8227-80f6d412c2de None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.758713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.771292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.774330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.774330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.774330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.774330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:09.774620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:09.776284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:09.789152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 134/280] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:09.796959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.810253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ef91-a8e7-4ca3-b34d-9b9d2804eb0d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.853432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.854083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.854328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.854598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.855882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:09.856386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:09.858129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:09.870666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 147/281] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:09.877386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:09.922174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f45d4-891b-4725-81c1-4fc4c66983d7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:09.939216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:09.975871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:09.976692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.977049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.977399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] PATH_INFO: `/v3/users/e9325ec36bf3429bb404096587095de0` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.979708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] RBAC: Authorizing `identity:get_user(user_id=e9325ec36bf3429bb404096587095de0)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:09.983392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29541f-19d9-48ab-beab-028ae5b3a7df None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:09.985481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 135/282] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/users/e9325ec36bf3429bb404096587095de0 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:09.987445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d500a-d32d-46c7-90d6-125192442724 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:09.987809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d500a-d32d-46c7-90d6-125192442724 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:09.988180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d500a-d32d-46c7-90d6-125192442724 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:09.989953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 136/283] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:09.991088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d500a-d32d-46c7-90d6-125192442724 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.019852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b66b9-9c7f-46ca-a7e3-daf0544c3d0e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.056462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.057522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.058079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.059091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] PATH_INFO: `/v3/users/92e17520bb24428dbe6164a0290b068c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.073877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:10.075059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] RBAC: Authorizing `identity:get_user(user_id=92e17520bb24428dbe6164a0290b068c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.077013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb75f5b-c708-471c-b26d-1e0fc0823063 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.079378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 148/284] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/users/92e17520bb24428dbe6164a0290b068c => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:10.081019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.081511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.081983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.101196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:10.102804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:10.133168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d500a-d32d-46c7-90d6-125192442724 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.174465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.175318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.175697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.176106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.177525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.178967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.180064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 149/285] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:10.181125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.189350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 137/286] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:09 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:10.196150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.212081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:10.315600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681301-ae33-47a1-9272-67f5097ca44c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.329864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f52b-b07b-4df0-a99d-cb49abfde768 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.356703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.357094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.357377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.357653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.358525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, user.id=92e17520bb24428dbe6164a0290b068c, scope.system=all) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:10.358829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.360383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.365829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 150/287] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 04:58:10 2022] GET /identity/v3/role_assignments?user.id=92e17520bb24428dbe6164a0290b068c&scope.system=all&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:10.366653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.367080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:10.384469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.385970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.386779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.387241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/users/e9325ec36bf3429bb404096587095de0/roles/52256f78efcb4eeb8e635a9e21f0f6ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.390279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, user_id=e9325ec36bf3429bb404096587095de0, role_id=52256f78efcb4eeb8e635a9e21f0f6ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.392090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.483123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:10.486287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 138/288] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:10 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/users/e9325ec36bf3429bb404096587095de0/roles/52256f78efcb4eeb8e635a9e21f0f6ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:58:10.503448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102998d3-b066-46fd-abf5-324d72d8ebf6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.547406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.548115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.548400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.548678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.562434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:10.567695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:10.568625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:10.569424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 151/289] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:10.577067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.728890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8172b-27ae-4d6e-8281-cd8c89a41685 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.770408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.771040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.771382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.771669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.772484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:10.772797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.774178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.784392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 139/290] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:10.790096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:10.925390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7bc4f-9d68-4509-bd7d-f13bae5eb236 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:10.975280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:10.975878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:10.976188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:10.976470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] PATH_INFO: `/v3/users/937e8f547f1a446e9b23f56514a78a3a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:10.977834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] RBAC: Authorizing `identity:get_user(user_id=937e8f547f1a446e9b23f56514a78a3a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:10.979352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:10.982043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 152/291] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:10 2022] GET /identity/v3/users/937e8f547f1a446e9b23f56514a78a3a => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:10.987750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:11.059852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:11.133838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb6743-a75f-4e2a-b8bc-27b0e06b9345 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:11.180869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:11.181535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:11.181818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:11.182094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:11.265511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:11.266876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:11.324992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:11.393247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 140/292] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.395986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:11.421095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:11.530740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b4f4a-74a5-43cd-8b42-a0e66b654b04 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:11.566568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:11.567219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:11.567503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:11.567783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:11.568999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:11.570466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab345b-01c6-475c-b24b-7c68859ca148 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:11.572159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 153/293] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:11 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:11.585325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:11.787832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29484-da40-4fa7-8bbf-becc458d1398 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:11.824158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:11.824948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:11.825299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:11.825643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:11.826514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=6233601cc710447c9dfe540205681493, user.id=937e8f547f1a446e9b23f56514a78a3a) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:11.826931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:11.828527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd40d-1a14-4c21-b118-9d16c107485f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:11.835362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 141/294] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:11 2022] GET /identity/v3/role_assignments?user.id=937e8f547f1a446e9b23f56514a78a3a&scope.project.id=6233601cc710447c9dfe540205681493&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:11.982993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce45d1d-adcb-4e32-acf1-b3f45a7a1979 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:11.982993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce45d1d-adcb-4e32-acf1-b3f45a7a1979 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:11.982993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce45d1d-adcb-4e32-acf1-b3f45a7a1979 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:11.982993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 154/295] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:11.989745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3ab0c-0ddd-43be-b260-bddfb314e426 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:11.990259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3ab0c-0ddd-43be-b260-bddfb314e426 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:11.990333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3ab0c-0ddd-43be-b260-bddfb314e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.021200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-31b3ab0c-0ddd-43be-b260-bddfb314e426 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:12.022554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-31b3ab0c-0ddd-43be-b260-bddfb314e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:12.026089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.130442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 142/296] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:12.181509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce45d1d-adcb-4e32-acf1-b3f45a7a1979 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.294699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.316673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce45d1d-adcb-4e32-acf1-b3f45a7a1979 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.356764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.357752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.358205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.358650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.363475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ad96-3c7a-4c2c-b9c4-b04172d347ed None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.363770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ad96-3c7a-4c2c-b9c4-b04172d347ed None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.364093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ad96-3c7a-4c2c-b9c4-b04172d347ed None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.367005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 143/297] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:12.372624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547445f-a8f4-45be-8864-01591b92475f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.372947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547445f-a8f4-45be-8864-01591b92475f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.373279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547445f-a8f4-45be-8864-01591b92475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.380745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:12.386526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:12.387624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:12.388578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:12.390609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 155/298] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:12.396490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.399787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1547445f-a8f4-45be-8864-01591b92475f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:12.404024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1547445f-a8f4-45be-8864-01591b92475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:12.494621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 144/299] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:12.520082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547445f-a8f4-45be-8864-01591b92475f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.534874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22743-ae9f-46ce-bbfe-fd55f00da221 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.572526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.573153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.573483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.573758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.575035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:12.575340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:12.576816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:12.586105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 156/300] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:12.592581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.596259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.600985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.629376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547445f-a8f4-45be-8864-01591b92475f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.683162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.684473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.684979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.685523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.686924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:12.688861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:12.690720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 145/301] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:12.701372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.723238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a30719-6c58-4e71-a9f0-9433867c21e5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.772786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.773728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.774411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.774838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] PATH_INFO: `/v3/users/561ccee1fdab434396928546f120394c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.799942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] RBAC: Authorizing `identity:get_user(user_id=561ccee1fdab434396928546f120394c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:12.799942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:12.800852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 157/302] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:12 2022] GET /identity/v3/users/561ccee1fdab434396928546f120394c => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:12.805877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:12.818300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36902fd-9735-4232-ad21-aaa93b7c2bc5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.863896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.864807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.865100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.865378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] PATH_INFO: `/v3/groups` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.866726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:12.868510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93577-42ae-47db-b626-af5f78fe471d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:12.872442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.911717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c48abf-6102-4b13-b128-169ac6830fab None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:12.942823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:12.955941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:12.955941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:12.955941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:12.955941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:12.956377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, user.id=561ccee1fdab434396928546f120394c, scope.system=all) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:12.956377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:12.956377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686350e-f276-4ffb-9914-d2ead999461f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:12.957706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 146/303] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Aug 4 04:58:12 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:12.961905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 158/304] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 04:58:12 2022] GET /identity/v3/role_assignments?user.id=561ccee1fdab434396928546f120394c&scope.system=all&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:13.024983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34410b-f6c4-43d6-802c-33dfd1c51f07 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.026000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34410b-f6c4-43d6-802c-33dfd1c51f07 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.026510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34410b-f6c4-43d6-802c-33dfd1c51f07 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.029130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 147/305] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:13.040955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcaf7-d3aa-44fe-b9da-17c7216cf7b5 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.041495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcaf7-d3aa-44fe-b9da-17c7216cf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.041495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fcaf7-d3aa-44fe-b9da-17c7216cf7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.063490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ac2fcaf7-d3aa-44fe-b9da-17c7216cf7b5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:13.065290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ac2fcaf7-d3aa-44fe-b9da-17c7216cf7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:13.150920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 159/306] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:13.174778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34410b-f6c4-43d6-802c-33dfd1c51f07 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.288720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720219-53b9-4ed6-9694-072d7211d97b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.289305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720219-53b9-4ed6-9694-072d7211d97b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.289722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720219-53b9-4ed6-9694-072d7211d97b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.292238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 160/307] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:13.299284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34410b-f6c4-43d6-802c-33dfd1c51f07 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.301030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.301788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.302067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.326546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:13.328291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:13.337824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.338466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.338748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.339073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.351007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:13.357217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:13.361062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:13.361855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 148/308] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:13.367945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.408309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.423933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 161/309] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:13.438890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.449934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.487602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370a37d-69bd-4d71-a2f6-8585de4e719b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.528656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.529880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.530611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.531498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.532748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:13.533257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:13.535118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:13.553275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 149/310] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:13.554039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.579212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9e3f1-5b70-49bd-93d6-47af886633b0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.617453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.618137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.618422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.618938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.630142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:13.635254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:13.636182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:13.637609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:13.642382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 162/311] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:13.643712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.692437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6639c81-9945-4214-aca6-890283814d18 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.698784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.738960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.744533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.745358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.746063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.746570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] PATH_INFO: `/v3/users/92e17520bb24428dbe6164a0290b068c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.748712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] RBAC: Authorizing `identity:get_user(user_id=92e17520bb24428dbe6164a0290b068c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:13.750836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:13.756096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 150/312] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/users/92e17520bb24428dbe6164a0290b068c => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:13.759749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.763995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00799e-24c7-425c-92b5-813b1870d5a8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.805182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.805754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.806037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.806315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.807157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:13.807440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:13.809602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:13.823730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 163/313] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:13.825704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:13.885501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce205da-f9f5-487f-a796-b39f5e22e4eb None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.921541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.922120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.922403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.922683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] PATH_INFO: `/v3/system/users/92e17520bb24428dbe6164a0290b068c/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.924218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92e17520bb24428dbe6164a0290b068c, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:13.925618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:13.955896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704431-d623-47ba-bb40-1930fecb82cc None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:13.967268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.991354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:13.992086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:13.992366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:13.992645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] PATH_INFO: `/v3/users/e9325ec36bf3429bb404096587095de0` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:13.993815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] RBAC: Authorizing `identity:get_user(user_id=e9325ec36bf3429bb404096587095de0)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:13.995252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:13.997693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 164/314] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:13 2022] GET /identity/v3/users/e9325ec36bf3429bb404096587095de0 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:14.002803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:14.028425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 151/315] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Aug 4 04:58:13 2022] PUT /identity/v3/system/users/92e17520bb24428dbe6164a0290b068c/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:14.130751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299c52-34b2-4ec8-a903-31c4e23d5884 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:14.173789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:14.174883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:14.175385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:14.175852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:14.230815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:14.254709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:14.256587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:14.362904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 165/316] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:14.368181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:14.425058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:14.474141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61805d-7b33-4a20-8e15-897b3884ee6a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:14.514088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:14.515089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:14.515625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:14.516131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:14.517494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:14.529086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c49b-366a-4d79-b72e-329c6daa8256 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:14.531590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 152/317] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:14 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:14.537512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:14.625189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:14.649095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed3a41-34f0-433c-a64e-38e34e168ce6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:14.686835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:14.687378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:14.687658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:14.687956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:14.688756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, scope.project.id=6233601cc710447c9dfe540205681493, user.id=e9325ec36bf3429bb404096587095de0) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:14.689070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:14.690674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d314d77-2a96-4aba-84c3-aee46494a405 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:14.697319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 166/318] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:14 2022] GET /identity/v3/role_assignments?user.id=e9325ec36bf3429bb404096587095de0&scope.project.id=6233601cc710447c9dfe540205681493&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:15.046856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68869f88-cb92-4b84-b9ec-a5e34e31ab97 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.047364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68869f88-cb92-4b84-b9ec-a5e34e31ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.047364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68869f88-cb92-4b84-b9ec-a5e34e31ab97 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.048847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 153/319] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:15.053870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.054158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.054431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.072457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:15.073641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:15.124824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c801e-2f21-4f15-8ff4-b51570a6e95f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.125135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c801e-2f21-4f15-8ff4-b51570a6e95f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.125389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c801e-2f21-4f15-8ff4-b51570a6e95f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.127571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 154/320] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:15.132482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.132764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.133041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.145950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 167/321] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:15.151618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:15.153503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:15.169116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.225622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 155/322] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:15.245047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:15.249494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.278894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5fd89-086f-4c60-85dd-5772ccb3ff53 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.302286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:15.320987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.321638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.321915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.322203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.334479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:15.340181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:15.341071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:15.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 168/323] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:15.348614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.359854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803897c-4d71-4f49-a41c-57006ee1701b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.395539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.396294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.400057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.400057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.400057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:15.400057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:15.400944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 156/324] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:15.408149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.466908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ef54c-b8e3-4db7-9774-887fe9b5b8be None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.497582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:15.503495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.504144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.512445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.512445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.512445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:15.512445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:15.512445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:15.515075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269075c-46ce-46be-ad45-1a6f0cb07f2f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.515790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 169/325] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:15.521257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.535533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:15.552874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.553429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.553714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.553988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] PATH_INFO: `/v3/groups` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.554651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:15.556117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:15.626155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a748e6-7fae-4b7e-8a43-c27e5a114bd3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.634588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 157/326] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Aug 4 04:58:15 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:58:15.663840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.664541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.664822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.665097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] PATH_INFO: `/v3/users/561ccee1fdab434396928546f120394c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.666504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] RBAC: Authorizing `identity:get_user(user_id=561ccee1fdab434396928546f120394c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:15.668886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ee666-8884-4dd9-b6d3-a7ee846e40ca None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:15.671134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 170/327] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:15 2022] GET /identity/v3/users/561ccee1fdab434396928546f120394c => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:15.676891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:15.785404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976a04-8138-42a2-8df5-2495d024e625 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:15.821898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:15.822790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:15.823084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:15.823349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] PATH_INFO: `/v3/system/users/561ccee1fdab434396928546f120394c/roles/52256f78efcb4eeb8e635a9e21f0f6ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:15.825017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=561ccee1fdab434396928546f120394c, role_id=52256f78efcb4eeb8e635a9e21f0f6ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:15.826396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e561b14-8cf7-4d67-9b40-b70ae775a46f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:15.873510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 158/328] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Aug 4 04:58:15 2022] PUT /identity/v3/system/users/561ccee1fdab434396928546f120394c/roles/52256f78efcb4eeb8e635a9e21f0f6ca => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:58:16.224234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9cca-852c-43f7-979c-7e594325b8e0 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:16.225088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9cca-852c-43f7-979c-7e594325b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:16.225372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9cca-852c-43f7-979c-7e594325b8e0 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:16.227723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 171/329] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:16.233981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:16.234432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:16.234616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:16.258193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:16.259417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:16.306260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:16.347563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 159/330] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:16.371128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9cca-852c-43f7-979c-7e594325b8e0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:16.456159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:16.505691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9cca-852c-43f7-979c-7e594325b8e0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:16.546602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:16.547259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:16.547542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:16.547817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:16.566409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:16.572067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:16.572962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:16.574847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 172/331] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:16.580329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:16.702036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19221349-2399-4e5e-b31d-64b0feb7df8b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:16.740765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:16.741392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:16.741674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:16.741949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:16.742867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:16.743176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:16.744607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:16.757352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 160/332] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:16.769011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:16.916035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28a91-e747-4e4d-a07d-620203623d61 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:16.941630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:16.958021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:16.958686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:16.958970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:16.967382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] PATH_INFO: `/v3/users/92e17520bb24428dbe6164a0290b068c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:16.967382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] RBAC: Authorizing `identity:get_user(user_id=92e17520bb24428dbe6164a0290b068c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:16.967382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500e3c2-b003-4983-a0bf-9c946aeed855 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:16.967382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 173/333] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:16 2022] GET /identity/v3/users/92e17520bb24428dbe6164a0290b068c => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:16.970793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:17.021198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:17.099930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533f91d-5d38-485d-97c3-7d7a9061ea35 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:17.143660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:17.144314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:17.144600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:17.144880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:17.145683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] RBAC: Adding query filter params (role.id=9415c525f6a9419fa101c978fd4ef2de, user.id=92e17520bb24428dbe6164a0290b068c, scope.system=all) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:17.145998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:17.147448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc27dd9-134e-442b-9c6f-8ff0d1415d8c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:17.163671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 161/334] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 04:58:16 2022] GET /identity/v3/role_assignments?user.id=92e17520bb24428dbe6164a0290b068c&scope.system=all&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:18.245651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68c43-9d3b-445b-9a51-68e8eb95e00d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.247095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68c43-9d3b-445b-9a51-68e8eb95e00d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.247550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68c43-9d3b-445b-9a51-68e8eb95e00d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.249407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 174/335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:18.254571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed76fcc-3865-40cb-8bab-57083db5b623 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.255057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed76fcc-3865-40cb-8bab-57083db5b623 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.255269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed76fcc-3865-40cb-8bab-57083db5b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.275894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-bed76fcc-3865-40cb-8bab-57083db5b623 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:18.277671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bed76fcc-3865-40cb-8bab-57083db5b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:18.389336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 162/336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:18.422774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf68c43-9d3b-445b-9a51-68e8eb95e00d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:18.557588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf68c43-9d3b-445b-9a51-68e8eb95e00d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:18.562547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1c7e9-5023-4251-b9d3-6a1d1d4cc677 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.563176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1c7e9-5023-4251-b9d3-6a1d1d4cc677 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.563665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1c7e9-5023-4251-b9d3-6a1d1d4cc677 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.565632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 163/337] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:18.570876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6567b-ed6f-455c-aa98-0429d82b7805 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.571443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6567b-ed6f-455c-aa98-0429d82b7805 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.571946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6567b-ed6f-455c-aa98-0429d82b7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.607922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ccc6567b-ed6f-455c-aa98-0429d82b7805 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:18.609388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ccc6567b-ed6f-455c-aa98-0429d82b7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:18.629624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:18.630643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.631137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.631638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.648976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:18.664909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:18.671342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:18.672514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:18.673358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:18.677023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 175/338] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:18.688160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:18.773030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:18.789488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 164/339] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:18.793256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45b25-be3a-461c-9289-7c63e22801d9 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.793256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45b25-be3a-461c-9289-7c63e22801d9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.793256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa45b25-be3a-461c-9289-7c63e22801d9 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.793500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 165/340] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:18.798987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.799275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.799556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.829888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:18.831019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:18.833384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d15135-2315-4c43-becb-be66f5e028a3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:18.898907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:18.899543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:18.899825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:18.900125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:18.900849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:18.901167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:18.904290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:18.927726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 176/341] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:18.930221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:18.985483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 166/342] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:18.986730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.084373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e47b6a-1bac-4470-8a86-24cc67df5dd0 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.096767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.133616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.145455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.146110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.146390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.146664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.164325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fceb-2970-4bc8-8cb1-dd6b46508a9a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.166248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:19.172520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:19.173468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:19.174262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 177/343] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:19.175398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.217408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.218284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.219055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.219506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.300991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:19.303434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:19.377584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba6c45-4e4c-4069-9a7e-45dd1f2c9af6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.406779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.416777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.420634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.420634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.420634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.430579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 167/344] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:19.431669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.435597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-26095b45-4b11-474b-8694-2b60a60027de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:19.442334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:19.443470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:19.444423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:19.446969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 178/345] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:19.453633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ad8b-ca30-463b-b284-186d6fedfe88 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.454333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ad8b-ca30-463b-b284-186d6fedfe88 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.454778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ad8b-ca30-463b-b284-186d6fedfe88 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.456588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 179/346] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:19.457488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89ad8b-ca30-463b-b284-186d6fedfe88 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.504347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.570893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c837d-7857-4d50-ad63-4f2eee3f7d35 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.581745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89ad8b-ca30-463b-b284-186d6fedfe88 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.619036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.619661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.619966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.620250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.621572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:19.621880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:19.623268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:19.630118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.630769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.631651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.631981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.633498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:19.635111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762cb0-186b-4eec-ab33-4b95281304a9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:19.635229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 168/347] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:19.636067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.641848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 180/348] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:19.643065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.643449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.643735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.668230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:19.670026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:19.698213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.753501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 181/349] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:19.754644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.775677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8b3e8-8c68-4d65-a7d8-fd623045ae8e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.807583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:19.822743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.823378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.823660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.824558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.825775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:19.826086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:19.828103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:19.840237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 169/350] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:19.841109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.897732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c8de7-a5b1-4b7a-ad7e-4953c0515b16 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.938564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904865f3-6236-446a-a970-93c027717417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:19.939661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904865f3-6236-446a-a970-93c027717417 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:19.940186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904865f3-6236-446a-a970-93c027717417 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:19.940675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904865f3-6236-446a-a970-93c027717417 None admin] PATH_INFO: `/v3/users/561ccee1fdab434396928546f120394c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:19.942104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904865f3-6236-446a-a970-93c027717417 None admin] RBAC: Authorizing `identity:get_user(user_id=561ccee1fdab434396928546f120394c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:19.943950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904865f3-6236-446a-a970-93c027717417 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:19.946922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 182/351] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/users/561ccee1fdab434396928546f120394c => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:19.948100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904865f3-6236-446a-a970-93c027717417 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:19.984113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb9d7-3c0b-409c-91ce-4cb58980ce19 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:19.992670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.030481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.031579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.032096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.032596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.039886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.041749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.044822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 170/352] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:20.045889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.085225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.092586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904865f3-6236-446a-a970-93c027717417 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.132493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.133534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.134093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.134560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.147593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:20.153927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:20.154873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:20.155695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 183/353] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:20.161185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.180629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712a945-6f72-4871-8b26-5ad4ed5ae6fa None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.232570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.233486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.233773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.234113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.282545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.305638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f33a88-fbd9-4db0-a6d1-8e4bc56abe22 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.324505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.326963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.352367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.352702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.352936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.353216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.354019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] RBAC: Adding query filter params (role.id=52256f78efcb4eeb8e635a9e21f0f6ca, user.id=561ccee1fdab434396928546f120394c, scope.system=all) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:20.354336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.356638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2ddd8-f2fb-4582-b629-96b77c8025f0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.403033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 184/354] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/role_assignments?user.id=561ccee1fdab434396928546f120394c&scope.system=all&role.id=52256f78efcb4eeb8e635a9e21f0f6ca => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:20.404527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445d9af-4781-4ab9-91a2-58858c45c5e1 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.404771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445d9af-4781-4ab9-91a2-58858c45c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.405054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445d9af-4781-4ab9-91a2-58858c45c5e1 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.406406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 185/355] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:20.407260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445d9af-4781-4ab9-91a2-58858c45c5e1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.429890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.512498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 171/356] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:20.517996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.547480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445d9af-4781-4ab9-91a2-58858c45c5e1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.595089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.595881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.596193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.596467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.597272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:20.597582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.599221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b51f5-a0ae-4520-a5ef-e188136a4220 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.607030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 186/357] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:20.607397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.609717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524a45-f764-4991-8ac4-39c7431ac24d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.609996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524a45-f764-4991-8ac4-39c7431ac24d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.610274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34524a45-f764-4991-8ac4-39c7431ac24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.631350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-34524a45-f764-4991-8ac4-39c7431ac24d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:20.632642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-34524a45-f764-4991-8ac4-39c7431ac24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:20.657059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf74-ebf6-49a1-99b4-aaef5c765c8b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.721612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.722560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.722961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.723328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.724688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:20.724998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.726453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.739026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 172/358] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:20.740276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 187/359] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:20.740560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.741904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ecc0-e0bf-4f73-bfd5-c174fd509146 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.742416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ecc0-e0bf-4f73-bfd5-c174fd509146 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.742770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ecc0-e0bf-4f73-bfd5-c174fd509146 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.744710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 188/360] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:20.749184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ecc0-e0bf-4f73-bfd5-c174fd509146 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:20.765377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.891157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1731c-faff-4343-86a4-dd3211e936a6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.893503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ecc0-e0bf-4f73-bfd5-c174fd509146 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:20.939013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.940077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.940579 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.941046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.946860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.953913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:20.954580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.954920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.955251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.957787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:20.958737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9904e-4a01-40c5-ae32-63b6e5f1ddc3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:20.966128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 173/361] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:20.966128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:20.966128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:20.966128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:20.985142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:20.987803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:21.052007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.053667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.066063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.070976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 174/362] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:21.071859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.195393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 189/363] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:21.196403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.229944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2583c-2738-4561-b2d1-352bbedeb79d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.279653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.287293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.288015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.288304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.288586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.302034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:21.315155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:21.316422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 175/364] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:21.317390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.341868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7550-6f9b-4d97-b6a2-bfe5fe9c1ac4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.358504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.393819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.394518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.394798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.395073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.396281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.397909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.399542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 190/365] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.400931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.461278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e75eba-b440-436f-89cb-9a3d03b15ea4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.502090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.503095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.503605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.504077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.517319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:21.522310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:21.523203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:21.524109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 176/366] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:21.524791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.539116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee579a-d696-4b03-ad02-4c37fe2c5e28 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.583461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.584177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.584457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.584732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.586348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.588968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.590491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 191/367] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.593254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.602003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.654255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.656447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eaf-058e-49ad-84d4-5a02229f17cb None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.713322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.715022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.715662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.716313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.717609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:21.718362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.720713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.723552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1876e2-4833-4aa7-a6b6-92c1c536dc36 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.733020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 177/368] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.733685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.770320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.770949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.771230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.771501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.772318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:21.772629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.774233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.780388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 192/369] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.781229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.878081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dab0f6-4885-4e42-acb7-9673b5c3c8bd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.900531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.913800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64fd39-93f2-4d96-814a-7427c9aa4568 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:21.926624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:21.931984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.933075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.933517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.933914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.934664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:21.934977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.937001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.951840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 178/370] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.953627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:21.961253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:21.962054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:21.962408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:21.962746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:21.964355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:21.966505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:21.968333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 193/371] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:21.969244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.099877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df094457-dfd3-46fb-a51e-4251ff231400 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.114218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083705f8-3fa7-4c53-a690-170322783733 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.146238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.147378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.147802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.148237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.161255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.161887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.162202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.162556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.207498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.220051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.250015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.252529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.253808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.255274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.389201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 194/372] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:22.390915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.395214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 179/373] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:22.400697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.490036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.506512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.520640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd483d-d465-4fea-acf6-e6278ac09e06 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.538202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d188d8-7130-487c-94da-02f857d12ac5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.565185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.566477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.566972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.567473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.568560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=6233601cc710447c9dfe540205681493) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:22.569072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.570848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.578232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 195/374] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=6233601cc710447c9dfe540205681493&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:22.579458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.594143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.595196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.595675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.596409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] PATH_INFO: `/v3/projects/bc8951b8f50642578f4f541f71fa515c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.598687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8951b8f50642578f4f541f71fa515c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.608937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.613992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 180/375] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/projects/bc8951b8f50642578f4f541f71fa515c => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:22.620621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.815469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bc23b-47eb-4fea-ab72-9ba311300679 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.831189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d526c7-1cd9-4c17-896e-e3c4431f14d1 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:22.867636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.868580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.869258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.869553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.872268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.873998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.876053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 196/376] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:22.880663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:22.881334 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:22.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:22.881946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] PATH_INFO: `/v3/groups/25217683da5f40649d7af9abaee7481b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:22.884713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.890186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] RBAC: Authorizing `identity:get_group(group_id=25217683da5f40649d7af9abaee7481b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:22.891659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:22.893812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 181/377] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/groups/25217683da5f40649d7af9abaee7481b => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:22.900082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:22.907041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:22.910245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:23.056685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016836b5-ac30-4967-a56c-a41f98e4ba08 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.057880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81972f-21fc-4c8e-b5a1-2a928a1c96f9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.098103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.098675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.098957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.099234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.100443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:23.101851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.102070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35f227-3926-4d49-a4b8-5258faf36c92 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:23.102478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.102758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.103031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.103833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] RBAC: Adding query filter params (group.id=25217683da5f40649d7af9abaee7481b, role.id=5a02b24f89c148f78d88275904494739, scope.project.id=bc8951b8f50642578f4f541f71fa515c) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:23.104030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 197/378] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:23.104193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:23.105168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b68e-c3db-4b0d-9773-c1aa90612ef6 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.105453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b68e-c3db-4b0d-9773-c1aa90612ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.105707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a74b-b62a-4e66-806a-8dd1d5bc512f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:23.105880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b68e-c3db-4b0d-9773-c1aa90612ef6 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.111873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 198/379] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:23.112325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 182/380] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:22 2022] GET /identity/v3/role_assignments?group.id=25217683da5f40649d7af9abaee7481b&scope.project.id=bc8951b8f50642578f4f541f71fa515c&role.id=5a02b24f89c148f78d88275904494739 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:23.112876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b68e-c3db-4b0d-9773-c1aa90612ef6 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:23.125624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.125947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.126183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.160322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:23.163824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:23.247724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:23.247949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:23.253564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 183/381] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:23.279271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b68e-c3db-4b0d-9773-c1aa90612ef6 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.293823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:23.359516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.360184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.360491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.360736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.361529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=6233601cc710447c9dfe540205681493) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:23.361834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:23.363279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:23.375257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 199/382] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:23 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=6233601cc710447c9dfe540205681493&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:23.440993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f636f6-6dd1-4153-9941-a493f7fd75c6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.490716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.491366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.491640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.491927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.507466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:23.513420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:23.514311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:23.515131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 184/383] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:23.522798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:23.666169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0878-f14e-4855-8014-49d88e215642 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.724277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.724915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.725201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.725481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.726210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:23.726520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:23.727923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:23.740383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 200/384] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:23.746522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:23.819688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:23.868574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdda16-1640-4e6a-9525-ddac48478485 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:23.905235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:23.905884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:23.906167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:23.906446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:23.907627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:23.909185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:23.911116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 185/385] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:23 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:23.916588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:23.920571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:24.045177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0c7e8-403b-4469-a45f-559e9536aa0d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:24.088183 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:24.088832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.089116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.089973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.091176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:24.092872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba6ab-a485-4d8b-a8ac-72e78ce5ad5e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:24.094642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 201/386] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:23 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:24.100523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:24.224290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f73a52-14c3-4cfb-a926-8c3633d2d36e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:24.236737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03e0-e131-414b-a37b-d0080a381cc2 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.237035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03e0-e131-414b-a37b-d0080a381cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.237298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb03e0-e131-414b-a37b-d0080a381cc2 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.238788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 202/387] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:24.243742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.244060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.244339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.271639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:24.272903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:24.279454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:24.293859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:24.294913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.295193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.295468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.300192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, group_id=bcdd42204b3e4829bc50b84d3cab8119, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:24.300310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:24.361059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:24.365755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 203/388] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:24.389503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:24.424223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 186/389] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 04:58:24 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:24.498146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43dc4a-fe0e-4ffd-9971-5c6db02b20e2 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:24.536085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:24.536760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.537053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.537316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.549842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:24.555079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:24.556118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:24.556921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:24.560035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 204/390] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:24.563033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:24.726740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271662-d614-4dc5-9b2c-a810b94a6566 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:24.766017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:24.766993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.767501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.768003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.769022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:24.769507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:24.771060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:24.784685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 187/391] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:24.786993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:24.857349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:24.900286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53953afe-0a9f-4c14-a4e4-769df6406be4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:24.940281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:24.940929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:24.941211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:24.941494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:24.942667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:24.944150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:24.945761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 205/392] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:24 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:24.952071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.011659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:25.077113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b01af-dad5-4bde-836b-e6c644284966 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:25.124384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:25.125141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.125429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.125713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.128833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:25.130316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7b4c3-6959-4890-a91e-0cdbd8e10911 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:25.132462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 188/393] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:24 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:25.139174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.207485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2eaae-b9be-489d-aaf6-12c2e2b2c91c None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.207829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2eaae-b9be-489d-aaf6-12c2e2b2c91c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.208077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2eaae-b9be-489d-aaf6-12c2e2b2c91c None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.209699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 189/394] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:25.215533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.215841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.216143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.257029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:25.258250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:25.261912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f6c9-1baf-4453-8db8-b7c84a6557f2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:25.298099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:25.298782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.299100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.299355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.301607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] RBAC: Authorizing `identity:create_grant(project_id=4584957d7bd84b5f9e23afb57e0eab6d, group_id=bcdd42204b3e4829bc50b84d3cab8119, role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:25.302241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:25.309040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:25.365576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 190/395] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:25.380136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 206/396] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 04:58:25 2022] PUT /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:25.400844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.466687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:25.538582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d4e5-b399-4a71-bac6-192b0d9a3b71 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:25.582169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:25.582944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.583182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.583469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.595806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-914f0ec7-e8a7-4a23-bb09-608c7180c967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:25.600978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:25.601855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:25.602667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 191/397] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:25.609915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.724102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0672-67a4-4877-aae6-2dbb391018ec None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.724697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0672-67a4-4877-aae6-2dbb391018ec None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.724697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0672-67a4-4877-aae6-2dbb391018ec None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.728022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 192/398] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:25.732751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.733990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.733990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.736197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626d223-5ded-4406-91b7-c5c723b4373d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:25.755239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:25.757013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:25.779741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:25.780519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:25.780806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:25.781080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:25.781812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:25.782133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:25.783517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:25.793080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 207/399] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:25.799263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.854092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:25.879097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 193/400] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:25.928986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:25.938463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4538db-f942-4603-8ec1-1629aadf4d9b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:25.979739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.023423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.024112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.024393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.024709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.025902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.028135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.034287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 208/401] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:25 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:26.041334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.062496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd50e6-a8c8-409a-a4e8-622b6a96a3ca None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.113688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.114795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.119632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.120185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.142932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-f3d16d98-adb7-4059-9ac4-74fdd069980f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:26.154792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:26.155784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:26.156630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:26.160165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 194/402] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:26.161835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd128-e5b8-4d0f-9fea-dc25fa4c6764 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.162394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd128-e5b8-4d0f-9fea-dc25fa4c6764 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.162872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cd128-e5b8-4d0f-9fea-dc25fa4c6764 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.164892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 195/403] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:26.172140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.172764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.173594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.195392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:26.197420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:26.234911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31f6e-5a4b-4ac4-ad96-3f69891d40c5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.265570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.291963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 196/404] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:26.291963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.297504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.298432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.298915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.299389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.300800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.302533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.309058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 209/405] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:26.312825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.353192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.439255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3ccbf-204c-42db-8dbb-60686fbb503d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.454512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117d94f-3633-4ac7-a6ec-9666691e0ca2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.478102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.478727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.479002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.479327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.480276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:26.480756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.482148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.491682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 197/406] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:26.496453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.502309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.503274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.503803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.504305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.506512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, group_id=bcdd42204b3e4829bc50b84d3cab8119, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.508781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.592111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 210/407] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 04:58:26 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:26.593142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.597909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.610922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab5f6a-6a08-4f28-bfd3-9fb43b41279a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.657319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.658633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.659573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.660099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.674799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:26.682100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:26.683652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:26.684506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:26.688199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 198/408] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:26.698116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.710340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.802441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6213a5e-6d7d-4035-84e5-dc62d029685a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.845297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fca73-903e-4517-a23f-d790488127ea None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:26.868449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.869109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.869439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.869665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] PATH_INFO: `/v3/groups/25217683da5f40649d7af9abaee7481b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.872343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] RBAC: Authorizing `identity:get_group(group_id=25217683da5f40649d7af9abaee7481b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.873842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.875855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 211/409] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/groups/25217683da5f40649d7af9abaee7481b => generated 229 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:26.882171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.892303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:26.892944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:26.893226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:26.893498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:26.894235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:26.894574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:26.896791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:26.911373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 199/410] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:26.918279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:26.943650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.093909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6966-f853-4a17-83e2-fd1dde60ee96 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.099932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b3df1-a87b-4887-bd22-c97ab5096067 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.126305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.144093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:27.151191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 200/411] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:27.161975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:27.170237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.170893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.171170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.171441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] PATH_INFO: `/v3/projects/bc8951b8f50642578f4f541f71fa515c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.172792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] RBAC: Authorizing `identity:get_project(project_id=bc8951b8f50642578f4f541f71fa515c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:27.174249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:27.175921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 212/412] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:26 2022] GET /identity/v3/projects/bc8951b8f50642578f4f541f71fa515c => generated 344 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:27.188544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:27.295502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.299051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f597a4-805d-4647-947c-47ed1d4b965e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.318608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad7fda-049d-4224-929c-a8162ccba955 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.348597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.350112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.350585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.351175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] PATH_INFO: `/v3/projects/bc8951b8f50642578f4f541f71fa515c/groups/25217683da5f40649d7af9abaee7481b/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.353990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc8951b8f50642578f4f541f71fa515c, group_id=25217683da5f40649d7af9abaee7481b, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:27.355789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8cf1a-56d7-4c53-91a5-5521cab1bc30 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:27.357341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.357985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.358265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.358543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.359754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:27.361363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab79c3-6ec9-40e3-a0da-e8a4a77753ce None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:27.367935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 201/413] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:27 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:27.367935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969887-9ca6-420a-b4ee-ea0e785fe5ad None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.367935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969887-9ca6-420a-b4ee-ea0e785fe5ad None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.367935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969887-9ca6-420a-b4ee-ea0e785fe5ad None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.367935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 202/414] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:27.368924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8969887-9ca6-420a-b4ee-ea0e785fe5ad None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:27.436032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 213/415] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 04:58:27 2022] PUT /identity/v3/projects/bc8951b8f50642578f4f541f71fa515c/groups/25217683da5f40649d7af9abaee7481b/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:27.436032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.436032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.436032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.477418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:27.481262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:27.531712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8969887-9ca6-420a-b4ee-ea0e785fe5ad None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.565496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.610189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.611355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.611637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.611929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.614731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 214/416] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:27.616861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] RBAC: Authorizing `identity:create_grant(project_id=6233601cc710447c9dfe540205681493, group_id=bcdd42204b3e4829bc50b84d3cab8119, role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:27.618452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:27.647328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:27.694084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 203/417] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Aug 4 04:58:27 2022] PUT /identity/v3/projects/6233601cc710447c9dfe540205681493/groups/bcdd42204b3e4829bc50b84d3cab8119/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:27.810860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517492-7d85-466f-a3e0-e66e4e2e45ec None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:27.863253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:27.863840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.864262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.864438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.884946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-7b7cf185-cf78-42cd-b315-d824ddbda9a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:27.890850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:27.891818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:27.892640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:27.893244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 215/418] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:27.898125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:27.912295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.985438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95d4f-1f87-4130-b941-0d970399e05f None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.986528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95d4f-1f87-4130-b941-0d970399e05f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.986823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95d4f-1f87-4130-b941-0d970399e05f None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:27.988741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 216/419] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:27.998878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:27.999191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:27.999428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.024885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b1b4-6653-43a9-855f-43a82ad89a5a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.033109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:28.034403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:28.078622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.081131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.084339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.084874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.085905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:28.086450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:28.088199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:28.104243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.111455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 204/420] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:28.124435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.180768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 217/421] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:28.211715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.224251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.256033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3546d-3db5-4cbd-8943-d18c5bb2c5c8 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.301390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.302075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.302364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.302645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.355246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fca50-7424-4e95-8dde-69a72a56ad4d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.392298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.392868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.393147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.393424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.393973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:28.395578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:28.405494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:28.411122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:28.412103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:28.413439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 218/422] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:28.420178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.448089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.484401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.509973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 205/423] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:28.517956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.547084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc10c6-2a83-4868-a659-7cf609bbbaa8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.619243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.619871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.620174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.620510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.621400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:28.621709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:28.623111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:28.643164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 219/424] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:28.651077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.718174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2bd2-a7f2-4b29-ab11-5e292625dcf5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.777913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.778561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.778838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.779107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.780313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:28.781757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:28.783695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 206/425] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:28.789053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:28.795690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.826840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d7e8-16de-49ba-9bd6-d8ef65803035 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.841737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:28.897736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.897928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bde3e4-c085-42fd-99b0-52bf2736402a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:28.898296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.898580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.898858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.940022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:28.940697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:28.940974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:28.941247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:28.942400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:28.943994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:28.946533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 207/426] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:28.952668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.064707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810535-60a2-4802-ba25-48bf7a77cd3c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.078610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.080127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782b5d5-104c-449b-8312-a68ea7e7187b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.084314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.108683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.110893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.110893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.110893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.110893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:29.110893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.112387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.129143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 208/427] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:29.220180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.242293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 220/428] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:29.248557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.290182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520609-f494-425e-bc69-d85a579105e3 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.290491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520609-f494-425e-bc69-d85a579105e3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.290739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520609-f494-425e-bc69-d85a579105e3 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.293807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 221/429] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:29.301420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.301716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.301969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.327339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:29.328690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:29.437212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625365d6-a3dd-4354-a830-eaaf6b9c8d30 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.454210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 222/430] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:29.482655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.484312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.484963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.485246 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.485523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] PATH_INFO: `/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.486718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] RBAC: Authorizing `identity:get_project(project_id=4584957d7bd84b5f9e23afb57e0eab6d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.488311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.490273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 209/431] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/projects/4584957d7bd84b5f9e23afb57e0eab6d => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:29.495533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.541601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.592990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7334e0-1d48-47e5-a9d2-4ac0a346aa42 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.608838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.624341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e649d-1c8e-4455-9dbe-81703ae854db None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.643472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.644550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.644985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.645403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.661658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:29.668217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:29.669913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:58:29.670715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:29.677137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.677437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 223/432] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:29.678438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.678438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.678438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.679441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.680277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.681040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.685168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 210/433] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:29.691113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.820607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320cb69-a555-47ed-a7e7-fbdda755d433 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.823047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974f065-aab6-40ca-97bc-1fcb317ece4a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:29.831009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:29.864277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.864999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.865540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.865896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.867390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:29.868063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.868940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:29.870062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.871020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.871437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.871645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.872526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] RBAC: Adding query filter params (name=member) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:29.872978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:29.875413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61630d64-1ff3-4269-b1e8-34c7018c9908 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:29.883983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 211/434] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=4584957d7bd84b5f9e23afb57e0eab6d&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:29.894477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 224/435] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:29.897380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:29.943082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00655a-2905-438c-af5a-49ec67ac463c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.943577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00655a-2905-438c-af5a-49ec67ac463c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.943850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00655a-2905-438c-af5a-49ec67ac463c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.945595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 225/436] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:29.952115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:29.952423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:29.952677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:29.981340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:29.982992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:30.034101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.038389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5220ba-1908-4428-8759-bb6f6891c9b0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.087111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.087681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.088858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.089888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.091945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 226/437] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:30.117195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.139771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.182236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.184452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.247409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002315-9488-480f-b68f-2e4356ce2f92 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.288977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.289648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.289927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.290172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.303225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4fa39bdf-5171-41ae-a329-6581f5b1b74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:30.308315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:30.309282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:30.310213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:30.313196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 227/438] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:30.316572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 212/439] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:30.316692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bd89-e35e-4109-900f-c50d9c939501 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.316692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bd89-e35e-4109-900f-c50d9c939501 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.316692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75bd89-e35e-4109-900f-c50d9c939501 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.316692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 228/440] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:30.316941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.320096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.320383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.320661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.341844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:30.342984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:30.366939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.395974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.412495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 229/441] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:30.413342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.426167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc1d98-387f-4f6a-abbc-77648706295c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.459926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.460531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.460807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.461075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.461780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:30.462080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.463444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.473295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 213/442] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:30.474193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.526368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd587e-c6db-4381-8957-dfd2e580088e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.560901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.561540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.561826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.562108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.563279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.564833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.566493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 230/443] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:30.567258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.575329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40513da0-0575-4d25-98cf-4b8fc856f6d2 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.593584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.606986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.611720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.612398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.612674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.612942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.623779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:30.628743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:30.629838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:30.630656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 214/444] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:30.631428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.674877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4368ef8-6e8c-4ac4-abf4-f235dd20745d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.711283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.712391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.716658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.716658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.738953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0e5e-9833-4d00-a9c7-2ac33d548b13 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.774284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.774917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.775194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.775525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.777847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.779290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.780929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 215/445] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:30.781688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.789208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.790667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.814766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.839870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:30.879614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9a8a-acc8-4e9f-b4ce-7a984a958661 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:30.891825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 231/446] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:30.892696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.918326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:30.918948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:30.919229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:30.919766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:30.920514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:30.920822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:30.922193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:30.930098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 216/447] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:30.930887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:30.993317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5bc4-e5b4-4423-adb8-70500d821583 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.017178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.028674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.029280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.029558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.029829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.030610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=9415c525f6a9419fa101c978fd4ef2de, scope.project.id=6233601cc710447c9dfe540205681493) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:31.030964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.032447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.034058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2073a6-e8b0-49e2-be49-ad15a24f6439 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.038523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 232/448] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=6233601cc710447c9dfe540205681493&role.id=9415c525f6a9419fa101c978fd4ef2de => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.039387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.060567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.072729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.073451 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.074265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.074767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] PATH_INFO: `/v3/projects/bc8951b8f50642578f4f541f71fa515c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.076058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] RBAC: Authorizing `identity:get_project(project_id=bc8951b8f50642578f4f541f71fa515c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.077617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.079674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 217/449] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:30 2022] GET /identity/v3/projects/bc8951b8f50642578f4f541f71fa515c => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.085214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.161974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea4e3c-b08d-45fa-8c84-f110661aabe6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.199669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.200441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.201464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.201464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.204323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db27744-c4ba-4c46-a876-528577b41705 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.243718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.244395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.244683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.244960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] PATH_INFO: `/v3/groups/25217683da5f40649d7af9abaee7481b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.247026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] RBAC: Authorizing `identity:get_group(group_id=25217683da5f40649d7af9abaee7481b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.248509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.250116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 218/450] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/groups/25217683da5f40649d7af9abaee7481b => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.256404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.267752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.282279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.284028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.325588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.375572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f450be0-f526-4278-a0ec-a518667e64ee None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.418262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 233/451] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:31.418438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.418930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.419041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.419260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.420374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] RBAC: Adding query filter params (group.id=25217683da5f40649d7af9abaee7481b, role.id=5a02b24f89c148f78d88275904494739, scope.project.id=bc8951b8f50642578f4f541f71fa515c) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:31.420509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.420699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.422140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.431808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 219/452] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/role_assignments?group.id=25217683da5f40649d7af9abaee7481b&scope.project.id=bc8951b8f50642578f4f541f71fa515c&role.id=5a02b24f89c148f78d88275904494739 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.514569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.528100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49142b-53c6-4ddf-b12b-b13dc57a08a2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.564097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.564764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.565046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.565324 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] PATH_INFO: `/v3/projects/6233601cc710447c9dfe540205681493` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.566577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] RBAC: Authorizing `identity:get_project(project_id=6233601cc710447c9dfe540205681493)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.568086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.569810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 234/453] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/projects/6233601cc710447c9dfe540205681493 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.576245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.676269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80389-f012-4e10-9dda-9a0635e72519 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.697454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:31.709488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.710129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.710408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.710677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] PATH_INFO: `/v3/groups/bcdd42204b3e4829bc50b84d3cab8119` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.711829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] RBAC: Authorizing `identity:get_group(group_id=bcdd42204b3e4829bc50b84d3cab8119)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.713350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd6cb8-3ec2-4860-8905-6cdce37207ae None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.715607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 220/454] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/groups/bcdd42204b3e4829bc50b84d3cab8119 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:31.721555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:31.819697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5d89-84e6-4062-8a10-e0d99b77e620 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:31.853263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:31.853869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:31.854151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:31.854428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:31.855462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] RBAC: Adding query filter params (group.id=bcdd42204b3e4829bc50b84d3cab8119, role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=6233601cc710447c9dfe540205681493) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:31.855779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:31.857252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcd2dc-2cae-460a-af1e-4eac01312a6f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:31.862908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 235/455] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Aug 4 04:58:31 2022] GET /identity/v3/role_assignments?group.id=bcdd42204b3e4829bc50b84d3cab8119&scope.project.id=6233601cc710447c9dfe540205681493&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:34.462413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd220cf-73de-4282-886f-30c4db16569d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:34.463087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd220cf-73de-4282-886f-30c4db16569d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:34.463087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd220cf-73de-4282-886f-30c4db16569d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:34.464471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 221/456] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:34.474558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2fb5-b6b5-4150-bb5b-1d218c00c277 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:34.475181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2fb5-b6b5-4150-bb5b-1d218c00c277 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:34.475181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2fb5-b6b5-4150-bb5b-1d218c00c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:34.497612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a51d2fb5-b6b5-4150-bb5b-1d218c00c277 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:34.498822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a51d2fb5-b6b5-4150-bb5b-1d218c00c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:34.517383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:34.581744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 236/457] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:34.627748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd220cf-73de-4282-886f-30c4db16569d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:34.758293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daaa1a-ece9-49b8-b2d6-ce58e192b37f None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:34.758814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daaa1a-ece9-49b8-b2d6-ce58e192b37f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:34.759242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daaa1a-ece9-49b8-b2d6-ce58e192b37f None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:34.761582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 237/458] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:34.765815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd220cf-73de-4282-886f-30c4db16569d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:34.767187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:34.767735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:34.768248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:34.810232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:34.814124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:34.876044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:34.876697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:34.876972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:34.877417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:34.902655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:34.904399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:34.931495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:34.932632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:34.934353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:34.934353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:34.934353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:34.934353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:34.940940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 222/459] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:34.955963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:34.959210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 238/460] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:34.998391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:35.099469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:35.195485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:35.234732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d5616-49ef-4b99-992c-d85dff150a89 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.245181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a4f-d025-4ce3-b62d-1936f37dcb99 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.301446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.302097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.302379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.302796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.314677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.320938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c5d0-9777-4850-87fe-be506c619702 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.324040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.327249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.334128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 223/461] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:35.335529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c369ac-7816-46f6-8c12-089afa108075 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.335818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c369ac-7816-46f6-8c12-089afa108075 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.336118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c369ac-7816-46f6-8c12-089afa108075 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.337319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 224/462] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:35.343078 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c369ac-7816-46f6-8c12-089afa108075 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-302c276b-0344-44e1-8faf-5f25ea45aa31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:35.357393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:35.358449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:35.359488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:35.359488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:35.359488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:35.359488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:35.366556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 239/463] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:35.366556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.366556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.366556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.387709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:35.389971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:35.468791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c369ac-7816-46f6-8c12-089afa108075 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.470731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:35.471246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 240/464] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:35.472116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:35.513367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.513992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.514278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.514566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.515235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.516708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.548450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:35.587126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba773c61-4bc8-49b5-af5f-d0a1db28cb55 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.621916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.628206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb08843-3f44-4204-9ca9-ada076b476a1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.637511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 241/465] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:35.638695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df082f-3bb2-4136-a184-8669c638ab0b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.638982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df082f-3bb2-4136-a184-8669c638ab0b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.639255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df082f-3bb2-4136-a184-8669c638ab0b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.640656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 242/466] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:35.641146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df082f-3bb2-4136-a184-8669c638ab0b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:35.655380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 225/467] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:35 2022] POST /identity/v3/users => generated 246 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:35.656523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:35.779593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df082f-3bb2-4136-a184-8669c638ab0b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.812368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:35.820485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfc1ad-6c02-464f-a0e9-5fbd3e2e81ec None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:35.831415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.832208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.832490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.832766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.851697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.853497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-72732c48-922f-46fd-9905-533692b252e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:35.872538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:35.873426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:35.874263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:35.874263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:35.874263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:35.874263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:35.874484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:35.874685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.875200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.875619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.876519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:35.876653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 243/468] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:35.878019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:35.878445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d4d5-1fae-46f0-8e0d-d229af0d8c67 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:35.878568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:35.878948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:35.899550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:35.900867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:35.986939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 244/469] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:35.987808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.002626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 226/470] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:35 2022] POST /identity/v3/users => generated 248 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:36.004475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101921-d78d-4181-a367-87f212de99b8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.005059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101921-d78d-4181-a367-87f212de99b8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.005809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101921-d78d-4181-a367-87f212de99b8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.007977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 227/471] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:36.015868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.019564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.019564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.045320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:36.047223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:36.060302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.115386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756749db-250f-445e-a4da-cf7e0e8bca9d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.118234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.132634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 228/472] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:36.139161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.159678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.160363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.160648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.160926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.161660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:36.161967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.163521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.184272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 245/473] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:36.185149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.301991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fade-502d-4dc0-bf18-72c79b5faa18 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.320806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3f5ea-d55b-4ea9-a200-ffa5e2238696 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.348945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.350178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.350608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.351180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.366812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.367451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.367735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.368056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.368274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.368782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.370146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.370323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.374093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:36.398221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:36.399135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 229/474] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:36.400002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.421333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.sql.core [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:58:36.421333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 04:58:36.421333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [parameters: {'id': 'ef1e72c2674e42cd8b5d797ff6cf91a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 04:58:36.421333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:58:36.447729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:58:36.448914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application yield resource Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise self.value Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application session.commit() Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:58:36.450148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:58:36.451369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:58:36.452276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:58:36.453486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [parameters: {'id': 'ef1e72c2674e42cd8b5d797ff6cf91a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:36.454468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 04:58:36.455548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.457027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 246/475] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 04:58:36 2022] POST /identity/v3/roles => generated 144 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:36.457027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.493464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.533613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392494-0432-4072-ad58-da69b4658af1 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.575206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.575835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0431c-2acd-4f72-82e6-c6c081bb6cd7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.576297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.576297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.576522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.577349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.579018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.617823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.618452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.618731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.619004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.619936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:36.620317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.621696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.639439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 247/476] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:36.639439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.690037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 230/477] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:36 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:36.690037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:36.798211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.811573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:36.839847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a6e1-c683-458a-8c7b-897f5440ab36 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.882087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e942-b0d5-4063-96d5-44526fab930c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:36.928778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.930010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.930495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.930972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.931196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:36.931861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:36.932165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:36.932413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:36.932522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:36.934529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfc2e7-bd1d-48b6-ad26-db3ca69a30aa None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:36.965335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:36.971237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:36.972427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:36.973261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 248/478] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:58:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:36.979302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:37.065042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 231/479] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:36 2022] POST /identity/v3/users => generated 249 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:37.101735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719f1d-242e-48d9-bce9-6911ece351a8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:37.143671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:37.144351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:37.144636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:37.144917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:37.145651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:37.145960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:37.147374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9557c1-82c6-4f64-a876-b39c529795c8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:37.158079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 249/480] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:37.980808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b79d-6e02-4bad-8bb9-291f9d1b13d6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:37.981794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b79d-6e02-4bad-8bb9-291f9d1b13d6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:37.982282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b79d-6e02-4bad-8bb9-291f9d1b13d6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:37.984236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 232/481] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:37.989272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:37.989724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:37.989829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.012480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:38.013689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:38.016865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:38.086073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 250/482] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:38.122929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b79d-6e02-4bad-8bb9-291f9d1b13d6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:38.267333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b79d-6e02-4bad-8bb9-291f9d1b13d6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:38.284886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:38.315584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:38.316261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:38.318863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:38.318863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.333088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-774985f2-2b8b-41f8-9936-7e3dec03b5f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:38.338232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:38.339885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:38.340728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:38.342215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 233/483] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:38.346263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:38.542120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3daac-f8fb-48e2-ae49-c68acf059b03 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:38.542483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3daac-f8fb-48e2-ae49-c68acf059b03 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:38.542583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3daac-f8fb-48e2-ae49-c68acf059b03 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.544115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 234/484] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:38.550519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:38.551061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:38.551533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.574766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:38.576485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:38.603255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649bce-79d4-4618-a47f-a914efbc56b0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:38.658453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:38.660437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:38.661777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:38.662280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.663381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:38.665241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:38.668011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:38.684417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 251/485] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:38.690892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:38.696999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:38.714063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 235/486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:58:38.794090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:38.862736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e05acf-b652-451a-8679-f3142fe7b177 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:38.902475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:38.903475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:38.903755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:38.904060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:38.916360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:38.919004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:38.936690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:38.937599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:38.939040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:38.939040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:38.939040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:38.939040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:38.939040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 252/487] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:38.943322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.020292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.035267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52253a0d-d5b6-46a3-a910-47e203db31ae None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.051420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.076803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.077449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.077721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.077991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.090691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:39.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:39.097801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:39.098809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 236/488] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:39.108969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.119167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fa5d-65c1-4044-85e4-70c0672b5a89 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.166073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.167280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.167966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.168449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.169728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:39.170296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.171974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.200047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 253/489] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:39.205956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.278974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860253aa-a675-49ec-9477-3e2e561e44eb None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.322151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3387-6799-452e-a5c6-f3e0094d9a15 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.342928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.366169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.366822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.367104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.367378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.379021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.379650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.379952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.380243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.380951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:39.381254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.382642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.385089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.386615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.401125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 237/490] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:39.407533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:39.413233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:39.414145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:39.415048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:39.420763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 254/491] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:39.430312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.440298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.522694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3191-21c4-480e-9971-d22f829e751e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.562446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.563105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.563392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.563669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.580844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.582744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-7207d9d2-0973-4375-ae48-e0b2ab0686d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:39.601295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:39.602233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:39.603100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:39.603100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:39.603100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:39.603100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:39.603100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 238/492] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:39.605193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97ca7-2958-4567-9289-7a1dc6054b01 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.605193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97ca7-2958-4567-9289-7a1dc6054b01 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.605193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97ca7-2958-4567-9289-7a1dc6054b01 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.606744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 239/493] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:39.607853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae466-2808-4bad-8e53-7934597b42af None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.608484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae466-2808-4bad-8e53-7934597b42af None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.608484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae466-2808-4bad-8e53-7934597b42af None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.612453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 240/494] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:39.612453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae466-2808-4bad-8e53-7934597b42af None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.639141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5279-a53c-4c5a-8246-127d1f9d8d81 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.685791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.686423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.686729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.686990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.687791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:39.688133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.689614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614afb6-70f6-4194-aebd-571f7e358f69 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.710954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.730588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 255/495] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:39.731872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89be5e-b3e4-433c-8693-9fcb1f18331a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.732190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89be5e-b3e4-433c-8693-9fcb1f18331a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.732663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89be5e-b3e4-433c-8693-9fcb1f18331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.739101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae466-2808-4bad-8e53-7934597b42af None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.750497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1f89be5e-b3e4-433c-8693-9fcb1f18331a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:39.751738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1f89be5e-b3e4-433c-8693-9fcb1f18331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:39.774633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.775252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.775539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.775819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.777195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:39.777499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:39.778782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.778910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf75ad-16b6-43b6-89be-894d1cfc0aeb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:39.791285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 241/496] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:39.793136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab49-b22f-4b02-8426-260413346d4c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.793445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab49-b22f-4b02-8426-260413346d4c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.793704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faab49-b22f-4b02-8426-260413346d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.812437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-48faab49-b22f-4b02-8426-260413346d4c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:39.813677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48faab49-b22f-4b02-8426-260413346d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:39.822134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 256/497] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:39.824068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293b0f-0d9d-4871-b535-d8e0836d966e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.824359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293b0f-0d9d-4871-b535-d8e0836d966e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.824635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65293b0f-0d9d-4871-b535-d8e0836d966e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.826081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 257/498] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:39.830649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293b0f-0d9d-4871-b535-d8e0836d966e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.889960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 242/499] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:39.890929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faab49-b22f-4b02-8426-260413346d4c None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:39.947621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65293b0f-0d9d-4871-b535-d8e0836d966e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:39.954407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:39.984555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:39.985186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:39.985471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:39.985751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:39.993341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faab49-b22f-4b02-8426-260413346d4c None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.016503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.032857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.033553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.033849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.034131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.041626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.043251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.056382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-a6eb068b-e625-4d5d-b490-d3228e23834f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:40.056894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:40.058396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:40.059316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:40.059935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.060009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 243/500] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:40.060009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.060438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.060547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.078920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:40.080177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:40.148476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 244/501] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:40.149265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.168018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 258/502] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:40.168828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.208906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.232117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.256948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8063f-83c7-40e9-939a-403f6902624e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.272861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167c64-6d7a-4f45-a35e-014dd03cd6a4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.294853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.295490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.295767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.296076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.306393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:40.309469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.310115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.313303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.313303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:40.313459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:40.314300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 245/503] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:40.315099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.325425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:40.330447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:40.331509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:40.332355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 259/504] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:40.333018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.419431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e95d0-1d4b-40ad-abd9-44e6140cf872 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.433453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.439416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9deed3-af45-4306-907b-b8104eaf09df None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.455650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.456343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.456679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.456954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.457764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:40.458072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.459573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.462745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.474543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.476318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.476318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.476318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.487028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.488629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.499533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 246/505] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:40.500438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:40.509775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:40.511389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:40.512313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:40.512313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:40.512313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:40.512313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:40.512313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 260/506] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:40.512576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.605515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a0070-8132-44e4-bac6-d0b9e941e4c9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.615153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded916-d04e-4361-b85a-a1f4d55c6d00 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.640903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.641541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.641818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.642092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.652267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.652895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.653008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.653179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.653456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.654175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:40.654478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.654572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.655845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.668887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 261/507] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:40.668887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:40.670167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:40.671105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 247/508] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:40.672712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.699016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.709798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.775927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14904c76-57a2-4189-bb13-36022d4c839c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.777992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d134e-b447-41e4-8925-36107b55ef50 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.810774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.811395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.811681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.811989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.812212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.812730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:40.812830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.813044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.813132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.813348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.814433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.824771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 262/509] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:40.825627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:40.891938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.893414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.918060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.939403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.939403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1197e2-cb5d-4db3-87b6-6379de9cac21 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:40.969989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:40.973936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:40.973936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:40.973936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:40.973936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:40.973936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:40.974272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:40.991490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 263/510] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:40.991490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.000052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 248/511] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:41.000913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.090693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974bf0-8fa7-489b-9c67-9ed77d9c8aaa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.104071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11052-2193-41e2-9834-e03118608092 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.127051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.127695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.128011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.128162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.128290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.139594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.140220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.142236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.142236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.142410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.142507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.142507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:41.142507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.143725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.154998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 249/512] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:41.155831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:41.157887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:41.158879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 264/513] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:41.164696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.173782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.264576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c9589-eaac-47dd-bb10-54e3b13ed299 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.267765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf04b4-3cc7-44dd-b39c-d0447def03f1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.299695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057266b6-de9e-450d-a626-086c98768058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.300370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057266b6-de9e-450d-a626-086c98768058 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.300654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057266b6-de9e-450d-a626-086c98768058 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.300931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057266b6-de9e-450d-a626-086c98768058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.302171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.302788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.303070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.303343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.304056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.305506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.312480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057266b6-de9e-450d-a626-086c98768058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.313956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057266b6-de9e-450d-a626-086c98768058 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-057266b6-de9e-450d-a626-086c98768058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:41.328569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:41.329616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 250/514] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:41.330645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057266b6-de9e-450d-a626-086c98768058 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.364883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.414788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 265/515] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:41 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:41.415774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.436864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057266b6-de9e-450d-a626-086c98768058 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.493245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.494440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.495641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.496263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.513837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.516192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.522650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:41.535031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:41.536174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:41.537485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:41.537485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:41.537485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:41.537485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:41.537895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 251/516] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:41.539532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.567231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd2b73-6658-40ef-aa13-afda772d9413 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.613937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.614352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.614713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.615067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.625019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.626514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:41.639449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:41.640599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:41.641629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 266/517] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:41.642902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.657127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.674832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e81a0-aa0b-4749-bb06-6c326a62fd2e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.718408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.719027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.719300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.719567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.720290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:41.720591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.721957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.734623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 252/518] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:41.735268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.774030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677742c7-5ac9-4d4e-b42a-474ada4c5067 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.801915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.812805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.813766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.814044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.814429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.815137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:41.817389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.817389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.829559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 267/519] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:41.830545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.854279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5ddb5-625f-47df-b26d-fe3548ee12ab None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.892143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.892973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.893362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.893703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.894509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:41.894875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.896488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:41.913826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 253/520] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:41.914825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:41.925356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:41.946553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02a917-f81b-4aa1-bee2-03ba588d2049 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:41.985108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:41.985711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:41.985992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:41.986267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:41.987017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:41.987323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:41.988834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.013316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 268/521] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:42.013316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.040932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cc37-47cf-4d4a-b969-5942aa3c8621 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.076668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.079723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.080488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.080840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.081182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.092311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.093892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:42.106328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:42.108064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:42.109163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:42.112265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 254/522] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:42.113444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.137768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf17e75-d8c8-4c58-85ae-732bd73d4a59 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.183198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.183896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.184699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.184913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.185180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.193271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.194893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:42.208894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:42.210073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 269/523] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:42.216582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.233126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efd8bc-19c9-4fe8-8547-09ea5f6a3fe4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.268962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.269607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.269890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.270165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.278859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.280459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:42.293102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:42.294003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:42.295160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:42.299571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 255/524] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:42.300417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.334892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ed9af-e199-4417-b5e6-dd1c67c21154 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.344109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.373154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.374548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.374833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.375113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.375970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:42.376522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.378428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.395940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 270/525] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:42.395940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.427340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc615ff4-440e-48a1-ae47-6e456d560fdc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.462282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.471866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.472675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.473011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.473338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.474308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:42.474716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.476311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.499318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 256/526] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:42.500398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.540172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dde05-d9ed-4891-bfb7-4c3ee3963ea9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.581889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.582442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.582739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.583015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.583846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:42.584199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.585711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.608826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 271/527] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:42.610045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.630286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be449f-08de-4ee6-9f7d-74c992444d16 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.641495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.681415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.682262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.682676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.683382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.684166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:42.684624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.686210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.713472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 257/528] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:42.715243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.738208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbeff9-2504-4077-9746-fd299e9ad688 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.774513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.775308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.775689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.776175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.777902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.840187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc664-6b55-4259-be63-289e6d55ad83 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:42.850437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.852100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:42.881622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:42.882592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:42.883283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:42.884243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:42.884748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:42.962699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 272/529] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:42.964372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:42.966798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:42.968810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.021594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.071697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000007-2214-410b-af33-9d6c95d17356 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.089543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 258/530] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:43.090902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.102251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.111341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.112005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.112293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.116504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.116504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=208ae4c88a3440599aad61ae876837b0) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:43.116504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.116504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.122293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 273/531] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:42 2022] GET /identity/v3/role_assignments?user.id=208ae4c88a3440599aad61ae876837b0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:43.123225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.217603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158924a-2687-4b4f-a322-7ef03dab0229 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.240723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaebc3-b5be-4c12-8e4c-9cc52e9b8ae7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.263104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.264293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.264766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.265228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.280458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.282323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.285633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.296751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.297424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.297711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.297990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:43.302378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:43.303281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:43.304172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:43.304172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:43.304172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:43.304172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:43.306111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 259/532] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:43.312942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.320873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.322736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:43.350582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:43.351481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:43.352407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:43.352407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:43.352407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:43.352407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:43.352407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 274/533] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:43.360669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.437276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e0a6e-30fe-4215-9862-81e85931481d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.492408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.493137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.495657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.497908 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.500061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.501047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:43.505430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.505430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.530894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 260/534] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:43.536669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.608161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.625668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b571-7ae5-4482-9129-878519de4f7f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.683337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db57a8-b9d3-48a6-b85e-fc72fa599eb0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.695847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.696520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.696838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.697192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.697915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:43.698820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.700495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e2e48-1ea3-4837-83c8-3156482dc9af None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.715335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 275/535] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:43.715780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8c9c-3872-4183-9d26-cc31542427e3 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.716093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8c9c-3872-4183-9d26-cc31542427e3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.717750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8c9c-3872-4183-9d26-cc31542427e3 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.718071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 276/536] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:43.719360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8c9c-3872-4183-9d26-cc31542427e3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.729944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.730599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.730985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.731262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.739439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.740792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-0d38bc2a-2ab1-4f8a-9451-cbeed7a21167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:43.755201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:43.758072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 261/537] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.760309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.762409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.779263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:43.780506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:43.843304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8c9c-3872-4183-9d26-cc31542427e3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:43.845930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.856723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 262/538] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:43.857862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.883223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:43.884390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:43.885242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:43.886182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:43.894748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:43.896555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:43.910716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:43.911719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:43.912608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:43.913025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 277/539] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:43.913954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:43.916730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:43.976091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417dbe4-2e38-499b-91f2-f43f24ec225a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.013897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.014524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.014806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.015077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.015841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.016172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.018075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.035939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f9e8-2137-47a7-9b16-974903d1c2ac None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.036131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 263/540] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.036131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.076859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.078168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.078658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.079197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.092174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:44.097968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:44.098904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:44.099716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:44.102644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 278/541] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:44.103720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.134033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:44.147060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39217bca-fe4a-4bae-90f0-303d4cae646c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.155885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:44.188593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.189218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.189501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.189777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.190539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.190993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.192689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.207051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 264/542] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.207955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.227211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22c919-491d-4d1d-83d7-e7945192e012 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.268186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.269728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.270218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.270698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.271834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=7435f7709c1e4a59881b02d58d8c8463) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.272504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.274172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.281797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 279/543] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/role_assignments?user.id=7435f7709c1e4a59881b02d58d8c8463&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.283011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.328280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400f30e-d57e-42cd-9e30-7b315f1a287a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.380618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.381619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.382267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.383605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.384647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.385164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.386801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.399236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 265/544] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.405401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:44.409015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.446101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea76ce3-f982-489c-989d-7317661a9e17 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.478589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:44.541958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3eec-d742-4722-bead-78d38baad2a4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.576985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.577733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.578118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.578391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.579092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.579294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=5915b2a090de42009ef03bf1d5a32f83) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.579580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.579766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.580063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.580339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.581098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.593270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.594750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.600486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 280/545] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/role_assignments?user.id=5915b2a090de42009ef03bf1d5a32f83&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:44.610576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:44.611518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:44.612528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:44.612528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:44.612528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:44.612528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:44.616404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 266/546] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:44.618228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.796968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0cc6-22e2-48c7-8ff3-8d173df94aea None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:44.858842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:44.859736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.860198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.860620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.862096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:44.862612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:44.864210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0670d-6bad-4b38-ab39-46d74d759b23 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:44.887109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 281/547] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:44.892775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:44.918025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037ac1-37df-4fce-9413-474c7ed47e05 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.918362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037ac1-37df-4fce-9413-474c7ed47e05 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.918588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037ac1-37df-4fce-9413-474c7ed47e05 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.920505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 282/548] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:58:44.926890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:44.927410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:44.927837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:44.960528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:44.960528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:44.968300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.034216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.078326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442ab53-cfff-4748-90db-cece6a6ea3f5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.105965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 283/549] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:45.132308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.150654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.152336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.152858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.153358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.173692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:45.176625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:45.201353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:45.202347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:45.203274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:45.218663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 267/550] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:45.226608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.338163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f1fbb-2dd1-4230-a9f3-43b8bf3cd6c8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.392578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.394117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.394866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.395348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.422832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:45.431633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:45.433334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:45.434174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 284/551] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:45.437068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6101b-3cd0-4a3a-8694-8f364478f8f9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.440392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.448926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.498245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.499158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.499741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.500079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.500891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:45.501202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:45.503755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131aea0-09e0-4aee-9960-a9c759c3f544 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:45.516752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.532086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 268/552] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:45.533953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee9366-28c3-485a-baf8-4018fd4b7219 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.534533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee9366-28c3-485a-baf8-4018fd4b7219 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.535002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee9366-28c3-485a-baf8-4018fd4b7219 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.537303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 269/553] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:45.538506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee9366-28c3-485a-baf8-4018fd4b7219 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.598552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93e79-309b-40dc-bf7b-fb5a34e2ba29 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.644272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.645042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.645333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.645610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.646661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:45.646975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:45.648681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982008-86e6-46c1-832e-7dc8c7688ecc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:45.657407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee9366-28c3-485a-baf8-4018fd4b7219 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.663545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 285/554] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:45.665812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.666103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.666382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.688985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:45.690361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:45.714791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.715856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.716319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.716739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.766449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.783452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 286/555] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:45.788318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.804790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:45.811110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:45.813140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:45.911147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb5b3-625c-42f2-903a-284e9c0a40d9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:45.947747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:45.948982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:45.949263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:45.949540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:45.958968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 270/556] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:45.960870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:45.961728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:45.963362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:45.980743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:45.981968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:45.983053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:45.983053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:45.983053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:45.983053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:45.988900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 287/557] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:45.989884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.045667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.094606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.099246 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d9115-d848-412b-ba7a-54436b768c3c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.125922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1cf6-e86f-42fc-a688-6cd3e8bf19d2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.139115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.139945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.140349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.140750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.156011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:46.163690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:46.165341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:46.166374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:46.169887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 271/558] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:46.170847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.178984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.179863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.180319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.181270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.198032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.201410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:46.222288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:46.223403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:46.224602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:46.224602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:46.224602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:46.224602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:46.227235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 288/559] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:46.228478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.303501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a211-6ce8-49db-b860-871f1a553f37 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.340777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6910d-b164-482a-8810-461b6a5e6445 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.342637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.350041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.350669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.350952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.351228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.352338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:46.352649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.354718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.372340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 272/560] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:46.373157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.384249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.385067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.386474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.386474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.387416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:46.387851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.389466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.396060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.399475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 289/561] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:46.405266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.497622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea4b33-544a-4091-b226-6c9bf8028cab None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.519093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf96c1-d69d-4b9d-9030-1af6cea4ba8b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.533063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.533683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.533973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.534249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.534952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:46.535261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.536668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.549082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 273/562] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:46.549933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.563040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.564198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.564661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.565112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.574301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.576080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-52ad2796-a596-435a-ab28-2cb5e18437a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:46.589905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:46.590928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:46.591863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:46.593249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 290/563] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:46.594480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf5cd-f1f0-4ab8-9574-988425cd44c0 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.594768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf5cd-f1f0-4ab8-9574-988425cd44c0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.595046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf5cd-f1f0-4ab8-9574-988425cd44c0 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.600224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 291/564] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:46.601063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cf5cd-f1f0-4ab8-9574-988425cd44c0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.625241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.646268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.668229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438849d-81f7-48f4-9cba-42b559ab7f1c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.713075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.714918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.715456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.715983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.719363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cf5cd-f1f0-4ab8-9574-988425cd44c0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.729092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.731345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:46.749228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:46.750212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:46.751092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:46.751092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:46.751092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:46.751092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:46.751092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 274/565] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:46.752031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.762935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.763583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.763861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.764167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.771338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.772855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a0b25149-70cc-4fa6-bb4c-f5b6cdc4958c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:46.786905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:46.788130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:46.789060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 292/566] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:46.789614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.789898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.790178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.809929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:46.811132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:46.872011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512469f-925c-415e-804d-8db0fccea6f5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:46.883664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 293/567] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:46.884565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:46.908219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.909057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:46.914250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:46.914879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:46.915163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:46.915439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:46.916300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:46.916618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:46.918892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:46.937519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 275/568] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:46.938360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.007770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc8557-3f73-472c-9858-694dcb7273fc None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.040652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49407e-34ad-4e1d-8190-53417f781fe0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.043421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.044335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.044620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.044895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.045587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.045893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.047301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.058673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 294/569] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.059502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.075636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.076286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.076563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.076834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.077579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.077884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.079357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.093161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 276/570] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.094513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.131804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.147999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.163631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47d57-0f92-4454-9c25-447a4f1de955 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.198944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.199600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.199881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.200186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.201412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45b042-63bc-409c-9a21-d6ce64fb2d1d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.210764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-33736fe1-8dc4-4b20-a348-9a362a83647f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:47.216925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:47.217869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:47.218724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 295/571] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:47.219411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e257ee-2bdd-45a3-a77f-ce18249a3262 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.219560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e257ee-2bdd-45a3-a77f-ce18249a3262 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.219863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e257ee-2bdd-45a3-a77f-ce18249a3262 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.221145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 296/572] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:47.221780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e257ee-2bdd-45a3-a77f-ce18249a3262 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.243840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.244518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.245400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.245723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.256199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.257820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:47.274382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:47.275461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:47.276593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:47.276593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:47.276593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:47.276593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:47.280611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 277/573] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:47.281454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.326796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e257ee-2bdd-45a3-a77f-ce18249a3262 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.356771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.362712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.363710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.364209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.364491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.372202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.373652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.379339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.382493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5366-a590-43b6-baff-5ebe8e8fca5e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:47.385303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:47.386609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 297/574] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:47.387545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.460287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.460918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.461199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.461473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.462262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=08b0d11d73184d26987ce4bdbfe05514) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.462621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.464466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21d5a3-7a2e-48de-8f9a-060a2000b8fe None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.470244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 278/575] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/role_assignments?user.id=08b0d11d73184d26987ce4bdbfe05514&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.471412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.471726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.472007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.491475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:47.492892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:47.554860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017681-f5b3-4496-87b4-66af78f56bbb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.570039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 279/576] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:47.571602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.607100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.608031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.608320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.608598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.609332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.609642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.611090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.620299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 298/577] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.621319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.686690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.688483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.694064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3f8e-3db7-4c97-9211-70d09b2f6a23 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.733255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.733888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.734444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.734962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.735848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.736704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.738111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.744595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d05db-7a5c-486c-ac15-0702d9f54703 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.750963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 280/578] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.751643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.792505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.792862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.793114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.793803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.794861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:47.795176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.797363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:47.820897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 299/579] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:47.821786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.864582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44468e-e86b-4347-97f3-a031dbdb8664 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.901549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.902191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.902474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.902750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.913945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:47.920573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:47.921540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:47.922406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 281/580] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:47.923131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:47.941365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.941974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e562c-a201-41f6-a8f6-0bcde2efc0b2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:47.953560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:47.977753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:47.978386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:47.978667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:47.978939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:47.989910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:47.991370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:48.007736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.008872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.009857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:48.009857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:48.009857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.009857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:48.009857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 300/581] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.011274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.042143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72b76-554a-4f5b-b8ae-6a39b980341f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.077998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.078658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.078939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.079209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.086264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.087719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:48.099943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.100871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:48.101785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 282/582] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.102273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.125270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e876-9d14-4b28-bb7a-02a4b01b7ed1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.163670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.164341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.164648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.164920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.177205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.178670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.192436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:48.194327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.195240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.196153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:48.196153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:48.196153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.196153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:48.196153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 301/583] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.196804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.215554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.227886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61745d7-37bd-4180-b539-a63bfeb93342 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.268126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.268666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.268947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.269225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.269942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:48.270247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.271654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.284843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 283/584] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:48.284843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.309526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab882e8-23bc-46c4-9151-7c961006b19e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.345651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.346548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.347001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.347280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.348010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:48.348322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.349717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.363707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 302/585] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:48.364601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.423547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04b8d3-59bc-4b52-988f-bf5f378455bc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.460489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.461016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.461295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.461558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.462436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:48.462618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.464976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.467897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.468736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.477934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 284/586] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:48.478631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.503997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1aca1-315e-445d-8c29-e441b5328728 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.539738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.540432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.540707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.540979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.541801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:48.542113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.543534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.558805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 303/587] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:48.559670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.590079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34471da8-ef49-4857-b4fe-ba79282383f3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.628845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.629569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.629895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.630130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.642077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.643653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:48.659802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.660745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 285/588] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.680634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff7003-46b9-4ff7-92f0-99ea5879c7d9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.720299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.720845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.721935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.722222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.722500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.724598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.731100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.732612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:48.744182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.745196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:48.746222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 304/589] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.747297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.780358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21b223-811d-4ed3-8dd8-a0c6c110a12e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.817590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.818252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.818535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.818808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.835501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=55b281089b494473a7b58228ac75c898, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.837005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.856673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381c661-78a4-426c-9ac5-f86d51648acf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:48.890564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:48.891204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:48.891491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:48.891772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:48.898570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:48.900102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:48.913110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:48.914058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 305/590] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:48.915414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.921482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 286/591] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:48 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:48.922724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:48.998420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.043709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.048572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3b90c-2eda-4add-8f63-9637645c0797 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.054595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c91cc-a232-4744-b617-5f6b2c69e11d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.097926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.098639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.098924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.099265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.100252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:49.100750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.102292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.117730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.118880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.119091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.119396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.121412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:49.121837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.123132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.133800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 287/592] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:49.134956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.139988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 306/593] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:49.146842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.271094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f9d0-9666-4022-8ab5-9154ba0ce245 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.276801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bafa43-8062-4047-8ffd-8fd7b803536c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.286448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.310010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.310655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.310936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.311207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.325035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.325661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.325937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.326207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.326967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:49.327291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.328755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.328881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.330943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.346497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 288/594] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:49.352709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:49.352832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:49.354133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 307/595] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:49.355163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.376813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.465362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5afadb-50fe-4bea-acdf-ff0ae9874ee5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.498364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a056d3b-96b6-428c-a24e-18abfe9e8ad4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.502473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.502941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.503313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.503660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/208ae4c88a3440599aad61ae876837b0/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.524671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=208ae4c88a3440599aad61ae876837b0, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.526817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafc244-337c-489f-8ac9-398165e02aac None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.538942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.539611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.539894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.540197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.551872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.553356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:49.568297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:49.571198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 289/596] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:49.572162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.596262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 308/597] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:49 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/208ae4c88a3440599aad61ae876837b0/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:49.597524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08793c-5ac2-433f-80c7-c55c0298e1de None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.597810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08793c-5ac2-433f-80c7-c55c0298e1de None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.598086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08793c-5ac2-433f-80c7-c55c0298e1de None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.600041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 309/598] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:49.604692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08793c-5ac2-433f-80c7-c55c0298e1de None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.636240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.669514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.727686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a8dc-9aff-4538-9b5e-7614f113c73a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.752493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08793c-5ac2-433f-80c7-c55c0298e1de None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.771020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.771664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.771976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.772276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.773094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:49.773406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.774993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104981d-d8e2-495b-bc00-92895a38d871 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.804051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:49.805059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.805556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.805993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 290/599] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:49.806319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.807844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:49.808086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:49.808195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:49.808475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:49.809058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:49.810657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:49.826471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 310/600] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:49.827783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.828009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:49.829278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:49.923992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 291/601] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:49.925254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:49.936288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:49.961150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99073-c1d7-47c1-95f6-a21a00809eb9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:49.998272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.007068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.007723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.009779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.009779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.022997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.024849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:50.046869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:50.047865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:50.049101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:50.049101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:50.049101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:50.049101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:50.050487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e07e-47dc-4f1a-8257-2b47999164f8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.052966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 311/602] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:50.054735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.089458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991517d-0058-4581-8938-98593ec41139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.090377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991517d-0058-4581-8938-98593ec41139 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.090851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991517d-0058-4581-8938-98593ec41139 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.091340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991517d-0058-4581-8938-98593ec41139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.099035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991517d-0058-4581-8938-98593ec41139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.100843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991517d-0058-4581-8938-98593ec41139 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-f991517d-0058-4581-8938-98593ec41139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:50.113736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:50.114880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:50.115999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:50.118238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 292/603] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:50.119191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991517d-0058-4581-8938-98593ec41139 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.202709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c29c02-ce6b-479c-8118-2d2d47dcb1f1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.241090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.241733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.242011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.242285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.246056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.249827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991517d-0058-4581-8938-98593ec41139 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.256192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:50.262187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:50.263381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:50.264411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 312/604] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:50.265160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.273700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.293773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.294964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.295462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.295892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.296830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:50.301418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.301418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.312541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 293/605] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:50.313591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.378340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c35ef-7cf8-4f49-a3da-74c58a40cf48 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.417098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.417975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.418258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.418532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.419549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:50.419857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.421334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.430632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5624da-a470-4e86-99b5-4eefb17a90d7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.434909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 313/606] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:50.435899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.469799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.470528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.470812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.471090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.471856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:50.472292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.473829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.483892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 294/607] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:50.484788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.497431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.530808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.545606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af322-b984-4314-bb76-f59bc95c3567 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.584156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.584816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.585456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.585804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.595261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.597566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.602113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875bfa0-f7ae-4a10-8109-b6c488d089da None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:50.612493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:50.613439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:50.614425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 314/608] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:50.614986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.644992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.646061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.646544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.647060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/7435f7709c1e4a59881b02d58d8c8463/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.664698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=7435f7709c1e4a59881b02d58d8c8463, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.666509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.745264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4fe0-c338-4439-8519-e559ba129715 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:50.764782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.775691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 295/609] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:50 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/7435f7709c1e4a59881b02d58d8c8463/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:50.778401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.787829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:50.788534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:50.788817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:50.789249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:50.806756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:50.808972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:50.837561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:50.839093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:50.840695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:50.840695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:50.840695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:50.840695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:50.845381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 315/610] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:50.851285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:50.972359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:50.986009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fe2d2-acb3-4a8f-99bd-fb7ffeecdbef None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.022489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6092aa-98e0-4e23-8405-aa6cf8dea20e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.023387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.024050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.029040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.029040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.029040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:51.029040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.029040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.041942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 296/611] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:51.048067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.065423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.066429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.066911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.067403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.068339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:51.068887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.070540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.087450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 316/612] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:51.097068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.165466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b9fb-f37c-4285-96c4-5fbd8acfb8c0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.199916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:51.204985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.205853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.206287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.206741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/5915b2a090de42009ef03bf1d5a32f83/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.223013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=5915b2a090de42009ef03bf1d5a32f83, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.224753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c3a54-8937-437e-9d53-6019de45db8e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.296654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf462e-bf21-4714-b4ba-00b8bac08623 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.298877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:51.301609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 297/613] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:51 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/5915b2a090de42009ef03bf1d5a32f83/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:51.305137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848558d-4b61-462f-b66a-364799b24ec0 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.305726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848558d-4b61-462f-b66a-364799b24ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.305829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848558d-4b61-462f-b66a-364799b24ec0 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.308608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 298/614] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:51.315141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.315577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.315983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.337271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:51.339084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.339355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.339632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.339811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:51.339995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.348765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.350209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:51.364127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:51.368755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:51.370234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 317/615] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:51.377780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.491475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 299/616] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:51.520894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.543019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:51.560564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dc62-1d1d-449f-9885-1e09ec779cd6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.606002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.606670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.607018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.607361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.608313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:51.608666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.610114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.629195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 318/617] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:51.634866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.640707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c755fb5-c36e-49ff-9c6b-97c89ed837e5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.670244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:51.679419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.682640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.682640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.682640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.704607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:51.709834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:51.710766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:51.711771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 300/618] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:51.719101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.774501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150ea3e-824c-45a8-b117-4c2a3610aea3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.824258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.827751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.828073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.828350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.848431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae503-520a-4658-a482-f56c7a57a664 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:51.849667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.856645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.867043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:51.885044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:51.900159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 319/619] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:58:51.901637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:51.912583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:51.913217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.913498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.913775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.914509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:51.914814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:51.920194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a78b7-b628-4f16-b663-97386a405af2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:51.933447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 301/620] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:51.939367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4465-9f4d-4952-a9f5-fdd8362ec885 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:51.939663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4465-9f4d-4952-a9f5-fdd8362ec885 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:51.939965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4465-9f4d-4952-a9f5-fdd8362ec885 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:51.945402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 302/621] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:51.945402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4465-9f4d-4952-a9f5-fdd8362ec885 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.018002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.034949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c87654-2a5f-4376-adbe-3be6ea9b135f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.073519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cf112-0973-436c-a764-1e346320a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.074777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf112-0973-436c-a764-1e346320a329 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.075291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf112-0973-436c-a764-1e346320a329 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.075784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf112-0973-436c-a764-1e346320a329 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.076702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cf112-0973-436c-a764-1e346320a329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:52.077233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cf112-0973-436c-a764-1e346320a329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.078938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cf112-0973-436c-a764-1e346320a329 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.082088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4465-9f4d-4952-a9f5-fdd8362ec885 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.093004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 320/622] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:52.094718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.095235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.095736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.114620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:52.116260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:52.120640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.120805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.121062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.121329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.133491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.135056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:52.152084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:52.153091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 303/623] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:52.154402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.181006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.196545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 321/624] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:52.204541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.278448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd9f7-44e4-4d9b-ab10-1a85cd3590ca None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.280457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.318925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.319860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.320333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.320756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.329230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.331068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.331845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a9ba1-7a8f-48a0-86d1-48215708a9a9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:52.344553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:52.345689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:52.346754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:52.348951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 304/625] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:52.350063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.372798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.373507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.374372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.374814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.375935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:52.376343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.378464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.398982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 322/626] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:52.398982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.457476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.468832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3d6a1-6c1e-4b00-919b-ddee68b3c14f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.505610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.506255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.506544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.506869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.512860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc1703-e144-45e4-90b0-2a0d5911bf56 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.519001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:52.524964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:52.526727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:52.527984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 305/627] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:52.532875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.554652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.556055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.556546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.557037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.558784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:52.559412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.561098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.572312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.575315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 323/628] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:52.576542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.643802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65e73-880b-4957-8746-0960b0b33025 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.681724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.682396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.682638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081b4d7-8af9-4143-b0f6-7927b7dd3ac6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.682748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.682938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.692388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.693535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.704346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:52.718608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:52.719841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:52.721076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:52.727792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.727792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.727792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.728190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.728324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 306/629] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:52.729077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:52.729531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.729829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.731336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.746174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 324/630] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:52.747366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.826118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.846966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaafb-1ba1-407d-beea-65024506c0ec None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.861136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ef6c-f7ea-4d30-a109-6d3c76b92b1f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:52.886649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.888041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.888492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.888920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/08b0d11d73184d26987ce4bdbfe05514/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.899268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:52.899996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:52.900361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:52.900739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:52.902305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:52.902720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.904411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.906669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=08b0d11d73184d26987ce4bdbfe05514, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:52.908459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:52.927949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 325/631] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:52.927949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:52.954947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:52.980413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 307/632] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:58:52 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/08b0d11d73184d26987ce4bdbfe05514/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:58:52.981365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.060528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bf939-fe09-4afd-9f35-d2e8eac5916b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.096893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5ce5f-9538-4cce-afa6-c0d3afad0e62 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.111223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.111888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.112203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.112480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.125890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.127365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.142290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:53.149014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:53.150037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:53.151063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:53.151063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:53.151063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:53.151063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:53.151063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 326/633] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:53.156041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.165494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.167009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.167513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.168375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.245430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.246895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5307c-ef42-45ba-b444-7c9f46652b25 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.267105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.293408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3a32-d174-440f-a558-665f083b895a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.335495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.335495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.335809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.336180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.337169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:53.337573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.339333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b725d-6c42-4d1e-9667-ae128cb56f76 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.355585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 327/634] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:58:53.357159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162e63-0153-439f-8506-2e2a87e5581b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.357552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162e63-0153-439f-8506-2e2a87e5581b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.357928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162e63-0153-439f-8506-2e2a87e5581b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.359518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 328/635] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:53.364305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162e63-0153-439f-8506-2e2a87e5581b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.378725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 308/636] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:53.380947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.381424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.382455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.407097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:53.408561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:53.449211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.486393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162e63-0153-439f-8506-2e2a87e5581b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.506225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 309/637] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:53.507449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.546094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.546931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.547314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.547690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.559855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.561702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.565212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:53.576430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:53.577634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:58:53.578790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:53.580922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 329/638] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:53.581908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.638296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d419df0-e988-4972-a359-d9b86f17e6e7 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.683258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.684433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.684867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.685693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.700845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.702838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.704556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e581-6eac-4247-8322-a9af20422d8e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:53.720750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:53.721914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:53.723031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:53.723031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:53.723031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:53.723031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:53.724720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 310/639] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:53.725610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.743322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.756557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.757509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.757509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.757776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.768973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:53.774505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:53.775740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 330/640] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:53.777346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.839734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:53.840037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0621969-6fcb-4236-9fdc-e180e2ea8780 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.882745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.883369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.883651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.883944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.884751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:53.885123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.885833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce451317-c6cf-470b-915b-32a8dc31dfdc None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:53.887180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c832c-7aea-4904-a046-d5c49f22b92a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 311/641] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd73eeb-e371-4e9f-9be7-d6f1bdcc4382 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd73eeb-e371-4e9f-9be7-d6f1bdcc4382 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd73eeb-e371-4e9f-9be7-d6f1bdcc4382 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 312/642] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:53.911628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd73eeb-e371-4e9f-9be7-d6f1bdcc4382 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.930840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:53.931475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:53.931757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:53.932099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:53.932950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:53.933321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:53.934655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:53.952036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 331/643] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:53.952036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:53.996293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.030345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd73eeb-e371-4e9f-9be7-d6f1bdcc4382 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.055220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541933a8-b76f-4a36-9c95-c0706003c24b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.070310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.071235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.071665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.072133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.073663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:54.073969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.075346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78382f54-fdde-4221-8019-9b00005cdb28 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.079295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.084654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 313/644] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:54.085940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.086278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.086563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.100308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.100938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.101212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.101495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.105502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:54.106719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:54.179785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 314/645] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:54.180484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.185021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.186410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.256157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.299465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b68ef-f04f-433b-a9c8-39462da30db6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.302114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 332/646] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:54.303038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.327788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.338340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.339019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.339338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.339617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.346991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.348489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:54.360345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:54.361461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:54.362827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:54.366077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 315/647] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:54.366919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.418093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e31f-4d13-40f8-8c02-c3899b99da2f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.455760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.456349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.456635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.456909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.467999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.469599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.473208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a071571-7110-40a7-9891-5c28dd97b1a5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:54.485427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:54.486367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:54.487284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:54.487284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:54.487284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:54.487284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:54.487284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 333/648] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:54.487575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.503220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.514865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.515501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.515780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.516082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.527124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:54.532205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:54.533361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:54.534310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 316/649] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:54.535091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.570356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.601760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d546-218a-4f66-85d6-7d384e55a086 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.639534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.640339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.640452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008dbd9-e433-4967-acd1-d383fee33411 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.640739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.641081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.654798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.656545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:54.673369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:54.674498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 334/650] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:54.680351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.683429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.684294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.684685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.685056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.685926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:54.686348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.687954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.704244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 317/651] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:54.705473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.754922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.808581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28fb30-f4fc-4dac-b254-0273656ddb90 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.816464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3155e7-a33e-4f83-89a8-4c84e330d1ec None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:54.836686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.849066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.851277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.851277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.851277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.851277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:54.851277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.852754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.856548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:54.857180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:54.857463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:54.857736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:54.859113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:54.859113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:54.860223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:54.866622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 335/652] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:54.869382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 318/653] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:54.870434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.872917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:54.998937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef873b7-040f-480b-a194-d9d87a8d7a3a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.005243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a384e9-67a4-4ae3-817c-66473b9ca6ee None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.007441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.041488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.045061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.046211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.047288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.048256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.048416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:55.048723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.049084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.049478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.049761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.050413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.050519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:55.050761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.052185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.072248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 319/654] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:55.072248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.080043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 336/655] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:55.081096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.150424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.206208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4615-6d9a-442d-8fd3-816f2bc06a7b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.219121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cbcb0-dd49-4d0c-824b-74e2222b9d1d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.245930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.246443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.246791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.247070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.256672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.258656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.262427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.263082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.263363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.264293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:55.272796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:55.273771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:55.274733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 320/656] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:55.275342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.278779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.280582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-04bfd905-4b2f-4dd4-bb08-74f34d3db813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:55.296905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:55.297849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:55.298733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:55.298733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:55.298733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:55.298733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:55.298733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 337/657] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:55.300325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555facd-0e9a-4202-9427-10f8d0ab1d4c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.300708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555facd-0e9a-4202-9427-10f8d0ab1d4c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.300991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555facd-0e9a-4202-9427-10f8d0ab1d4c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.302478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 338/658] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:55.307566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555facd-0e9a-4202-9427-10f8d0ab1d4c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.312097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.391569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e696e1-34a0-420e-915e-c2ed09df3b67 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.424572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.428322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.428961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.429296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.429571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.431455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555facd-0e9a-4202-9427-10f8d0ab1d4c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.436939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.438387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:55.450674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:55.451594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:55.452537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 321/659] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:55.453032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.472812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.473435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.473713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.473984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.474771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:55.475293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.476549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83ae0b-1ec0-49b8-8e88-12b32e779351 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.495686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 339/660] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:55.496994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.497281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.497558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.515999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:55.517117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:55.561064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.572284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031859-3309-4629-98e7-d80ddcb8c328 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.589338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 340/661] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:55.590191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.631596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.632265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.632543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.632816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.633505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:55.633804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.636224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.654302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 322/662] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:55.654302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.682381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.700086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795ade-2ad8-424b-ad7a-07001c67ffd8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.738594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.739212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.739490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.739763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.740544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:55.740850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.742707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.755369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 341/663] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:55.756683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.771644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc59e5-5363-44cc-9736-d3283201ac7d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.811339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be7910-e789-459a-a335-29556423ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.812278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7910-e789-459a-a335-29556423ca70 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.812822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7910-e789-459a-a335-29556423ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.813088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7910-e789-459a-a335-29556423ca70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.834293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:55.879002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640d37-8be8-428a-ba8e-95727239dac2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:55.890239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7910-e789-459a-a335-29556423ca70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:55.891698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7910-e789-459a-a335-29556423ca70 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:55.915866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:55.917343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:55.917893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:55.918319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:55.929867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:55.936043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:55.937146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:58:55.938116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:55.940231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 342/664] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:55.941195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:55.947050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.008374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 323/665] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:56.008374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be7910-e789-459a-a335-29556423ca70 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.056900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189254a-d07a-48ca-915b-f6138a7d5a06 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.062892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.094165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.094798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.095067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.095338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.103343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.104873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:56.117165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:56.118185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 343/666] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:58:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:56.119143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.122395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be7910-e789-459a-a335-29556423ca70 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.160480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.161477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.161755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.162027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.162816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=208ae4c88a3440599aad61ae876837b0) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:56.163122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.164591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.172569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 324/667] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/role_assignments?user.id=208ae4c88a3440599aad61ae876837b0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:56.173530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.212847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.274246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef156e4-b0bc-4524-8654-913a66f96c72 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.305917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e91f9-395d-4a0b-abcf-dfeaf11e2d65 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.323155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.324166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.324467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.325274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.325761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.326727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:56.327297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.328954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.339491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 344/668] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:56.343870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.352508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.354542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.354983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.355261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.370553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.372110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:56.389757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:56.390935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 325/669] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:56.391834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.492895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a82bf-62e4-48a0-9dd4-422b6508bc64 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.522299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.527578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6507e3-1f18-4228-8f4f-5a0dcaa98870 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.538564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.539671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.539985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.540269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.542136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:56.542597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.545159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.574850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 345/670] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:56.576089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.579857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.580682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.580963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.581239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.594044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.595642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:56.611879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:56.613031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:56.614101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:56.614101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:56.614101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:56.614101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:56.617819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 326/671] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:56.618718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.641103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.696690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f57e68-f464-4cfa-ab8b-96007885b1ac None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.739469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.740390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.740832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85121-7946-499f-8b77-2e1697f9cd8d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.741007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.741425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.742559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:56.743268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.745759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.759368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 346/672] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:56.761070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.787704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.788379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.788666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.788990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.815060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.871867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.873459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.879140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf105ff-eaff-4545-b50d-faaaebf4ef5c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:56.893795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.919126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:56.920062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:56.920523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:56.920950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:56.921808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:56.922263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:56.923799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:56.938667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 347/673] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:56.939774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:56.992667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 327/674] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:56.997980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.058543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4e105-4bc7-46aa-9dfa-e5a183c7ddaa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.061574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.098467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.099232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.099587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.099871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.108136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.109696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.110686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6725-11b9-4172-8ab9-485b45598f8f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:57.122805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:57.123939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:57.125127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:57.128247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 348/675] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:57.129248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.134639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.158014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.158930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.159397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.159822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.169565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.171285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:57.184535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:57.185760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:58:57.186842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:57.192932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 328/676] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:57.194104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.258909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55673b-243b-4224-8468-507b734e9e92 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.305866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.307138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.307812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.308331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.312622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36058422-3cf4-4649-8959-fa15cda6b7a4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.322668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.325519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:57.343228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:57.344328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:57.345254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:57.345254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:57.345254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:57.345254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:57.345254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 349/677] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:57.345985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.356476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.357004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.357290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.357567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.358405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:57.358925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.360189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb64a1-3ea8-4f8b-8423-876a13922a14 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.366653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.380594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 329/678] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:57.380594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06862669-c6bc-48ca-be2b-c2d478d670ff None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.380594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06862669-c6bc-48ca-be2b-c2d478d670ff None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.380594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06862669-c6bc-48ca-be2b-c2d478d670ff None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.381508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 330/679] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:57.382448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06862669-c6bc-48ca-be2b-c2d478d670ff None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.438705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.485952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429859-575c-419c-a0e0-e54cd39c4221 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.524047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06862669-c6bc-48ca-be2b-c2d478d670ff None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.531029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.531783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.532094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.532368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.535149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:57.535505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.537033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.563943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 350/680] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:57.563943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.578515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.579258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.579546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.579823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.580567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:57.580876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.582391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5fa1-84fc-4db0-93ff-59976d6c3fa2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.603016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 331/681] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:57.603016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.603016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.603016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.622483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:57.623898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:57.662222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.696431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb1183-f4d7-4bf7-ac28-f72f7a5bfdd3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.706751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 332/682] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:57.708293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.742496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.743249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.743441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.743663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.745542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=7435f7709c1e4a59881b02d58d8c8463) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:57.745864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.747333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.754164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 351/683] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/role_assignments?user.id=7435f7709c1e4a59881b02d58d8c8463&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:57.754989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:57.769697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.880911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f276e-5e70-4745-a422-069f4ac3efb0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.897483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45de1-0738-45ef-81cd-2b9b3b739727 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:57.924637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.925726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.925726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.925726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.943244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:57.944424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:57.944917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:57.945413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:57.954256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:57.956090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:57.959798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:57.970779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:57.975135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 352/684] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:57.976059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.020378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.022044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.057600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.144695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557bce-1d1b-4c84-96ad-48d3d90f0c87 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.149168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 333/685] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:58.149936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.206209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.207241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.207734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.208349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.221164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:58:58.227997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:58.229255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:58:58.230313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:58.233279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 353/686] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:58.234374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.267369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd792dd9-0f61-4777-9442-2576a425a346 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.296112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.298354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.305042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.305667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.305950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.307697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.307697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:58.308177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.309710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.327933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 334/687] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:58.335003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.346545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c02ff-5584-4cda-bbee-31989827ee6f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.383956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.384757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.385696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.386070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.397845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.399443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:58.415946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:58.417099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:58.418305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:58.418305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:58.418305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:58.418305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:58.418305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 354/688] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:58.418661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.443975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7538-7b64-4cb1-ac79-237c6564ce00 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.481628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.482346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.482734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.483116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.483984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:58.484403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.485884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.495416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 335/689] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:58.496424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.527219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f018-588e-43c4-b3ed-4514ada03d5d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.538651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.555329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.565774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.566621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.567067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.567527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.568546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=5915b2a090de42009ef03bf1d5a32f83) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:58.569034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.570644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.578786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 355/690] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/role_assignments?user.id=5915b2a090de42009ef03bf1d5a32f83&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:58.579862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.633206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f968c9-aad7-4db1-99e4-d8cf94bff668 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.679212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.679853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.680170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.680447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.681162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:58.681472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.682969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c7cc-f172-47f6-9dbf-c2827005ad75 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.696584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 336/691] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:58.698231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542bd5-db62-4f9e-98aa-92cef7041cd2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.698649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaec3a-c637-48c5-a2fb-7a6b62b251f2 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.698941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaec3a-c637-48c5-a2fb-7a6b62b251f2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.699216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaec3a-c637-48c5-a2fb-7a6b62b251f2 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.704999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 337/692] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:58:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:58:58.705706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaec3a-c637-48c5-a2fb-7a6b62b251f2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.741657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.742969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.743867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.744673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.761168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.763821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-d8e0a244-0b60-4d80-9071-815577d533d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:58.785972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:58.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:58.787989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:58.787989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:58.787989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:58.787989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:58:58.795235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 356/693] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:58.795235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.795235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.795235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.819426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:58:58.821615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:58:58.840453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaec3a-c637-48c5-a2fb-7a6b62b251f2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:58.853523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.856956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.895165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:58.895966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:58.896474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:58.896766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:58.906709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:58.907774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 357/694] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:58:58.908994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:58.912313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:58:58.937034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:58.937968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:58:58.938880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:58.946348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 338/695] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:58.947664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.048235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda71415-428e-4a1b-9302-89a48c8239c1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.085046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546b17e-8a9e-49a9-8723-c805d7df71e4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.089624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.090172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.090452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.090786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.091486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:59.091837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.093343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.107134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 358/696] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:59.108110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.127711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.128475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.128735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.129031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.141629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.142540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.143660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:58:59.160230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:59.161796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 339/697] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:59.162715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.201528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.267790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa18da-d0de-4d81-a1ed-4314112df679 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.288336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e6d0d-94ec-408e-bb56-4c9b038a870c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.313504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.314057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.314746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.315034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.316093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:59.316410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.318501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.327406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.328335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.328793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.329241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.339610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 359/698] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:59.340596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.340860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.343040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:58:59.356548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:58:59.363371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:58:59.364949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:58:59.365855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 340/699] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:58:59.366913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.448953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.459492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.477215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e507-1f8c-4eb7-bb09-6825e602fc59 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.487505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffbf1-c85e-437d-90b5-96683211a09a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.517816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.518960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.519520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.520028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.520926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:59.521603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.523381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.531335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.531976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.532261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.532558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.533847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=08b0d11d73184d26987ce4bdbfe05514) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:59.534162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.536259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.538934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 360/700] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:59.540289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.548045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 341/701] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/role_assignments?user.id=08b0d11d73184d26987ce4bdbfe05514&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:59.550147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.748161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13252-aeb0-43c4-bc5c-d59c12662d72 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.759560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b9a0-cf4c-4aec-a20c-5fa46fd5194a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.787323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.788098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.788480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.788765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.789574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:58:59.789886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.792331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.795735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:59.798270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.799132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.799574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.800705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:58:59.801560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:58:59.803164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c382d-1911-48c3-9d70-2eb9c042d421 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:58:59.813557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 361/702] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:58:59.819302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:58:59.897132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 342/703] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:58:59 2022] POST /identity/v3/users => generated 254 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:58:59.950029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc96ee-1b61-4d0e-9382-97b2cb4cfebb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:58:59.992675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:58:59.993235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:58:59.993515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:58:59.993787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.069491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b42d-f9e5-4b79-867c-f17d50c6e3c8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.069839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b42d-f9e5-4b79-867c-f17d50c6e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.070059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b42d-f9e5-4b79-867c-f17d50c6e3c8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.071169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.076329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 343/704] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:00.078313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.078805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.079281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.080884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.082360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.088836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.107197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:00.108454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:00.214547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 344/705] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:00.222881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 362/706] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:00.229267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.240166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.390635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f71e-6abf-4470-916f-378db7087acc None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:00.392277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.410001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce14c3-b829-47af-b44c-10b660f2b8c9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:00.432535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.440004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:00.440655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.440936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.441206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.454391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.456559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:00.475755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:00.476785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:00.477721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:00.477721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:00.477721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:00.477721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:00.477721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 345/707] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:00.484666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.513307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:00.513964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.514241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.514514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.515156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.516568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:00.536883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:00.539193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:00.541294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:00.548453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 363/708] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:00.549579 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.682923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16ad5-d12d-4400-861e-5f48f84b53ea None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:00.703279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f595f-0e66-4910-96a1-24db54cd22db None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:00.743523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:00.744188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.744890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.745169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.745983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:00.746287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.747742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.753019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 364/709] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:00.758738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.769963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:00.770597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.770882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.771159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.771860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:00.772203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.773579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.791295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.798476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 346/710] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:00.805291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:00.887962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6034f27-2b40-4dc0-a088-6399d7b698ba None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:00.928150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:00.929252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.929598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.929871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.930552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:00.930853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:00.933577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94ce9-a686-49ea-af2c-3bfe2a9cd79e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:00.940699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 365/711] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:00.947248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:00.951163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ec49-378a-476c-8a81-08de2be3f3f0 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.951978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ec49-378a-476c-8a81-08de2be3f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.952469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ec49-378a-476c-8a81-08de2be3f3f0 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.954698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 366/712] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:00.961621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:00.962316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:00.962777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:00.991432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:00.993287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:01.009685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e7c3-4bf8-4590-b908-d760da4b4357 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.051965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.052620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.053005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.053286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.062858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.064416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:01.077576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:01.078547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:01.079523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 347/713] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:01.085053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:01.103099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 367/714] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:01.128084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:01.149856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:01.224485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002f7d-7542-499f-a531-e01d0bd564b6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.227127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:01.253923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286745-5c35-4264-b91f-331430ae5d39 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.282792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.283416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.283718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.284029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.284757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:01.285067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.286949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.299749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.300835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.301334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.301814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] PATH_INFO: `/v3/services/network` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.302218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 348/715] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:01.302955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.304727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.309359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:01.318366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:01.319404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:01.320246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:01.329264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 368/716] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:01 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:01.330632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:01.429136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9695bb-9f16-4d58-93c2-8a8c622b05bc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.471664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.472347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.472629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.472909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.473706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:01.474014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.475508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.494182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 349/717] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:01 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:01.576684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:01.582627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c4078-1a44-477b-ae63-54fb1c590e3c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.623443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.628725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.628999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.629276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.629975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] RBAC: Adding query filter params (name=network) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:01.630279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.631673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481b25-f48e-4dfc-80fb-8394adeef251 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.638142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 369/718] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:01.645042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:01.706982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:01.786950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d113c-3214-412d-8d0d-42644dcfe14f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:01.832620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:01.833256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:01.833539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:01.833814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:01.834505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] RBAC: Adding query filter params (type=network) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:01.834810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:01.836203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63712-c9eb-4745-94a1-8fc423337cea None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:01.843204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 350/719] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:02.276569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5887-6fce-4b6f-ba8e-c3c4b8ceda7a None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:02.277094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5887-6fce-4b6f-ba8e-c3c4b8ceda7a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:02.277204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5887-6fce-4b6f-ba8e-c3c4b8ceda7a None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:02.278861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 370/720] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:02.283976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:02.284395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:02.284537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:02.308513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:02.309718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:02.394543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 351/721] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:02.442054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5887-6fce-4b6f-ba8e-c3c4b8ceda7a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:02.578001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5887-6fce-4b6f-ba8e-c3c4b8ceda7a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:02.615220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:02.615929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:02.616292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:02.616565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:02.628195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:02.633184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:02.634168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:02.635873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 371/722] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:02.640978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:02.683262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:02.818095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe598c-dbe2-45f3-9c47-4baf998781be None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:02.870236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:02.871294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:02.871565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:02.871840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:02.872587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:02.872887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:02.874276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896075f-3efc-4415-8009-ee86f0087d8b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:02.889039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 352/723] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:02.894249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:02.905022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.019561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddad-818d-486f-8d95-ac360808e76d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.019919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddad-818d-486f-8d95-ac360808e76d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.020172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddad-818d-486f-8d95-ac360808e76d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.021780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 353/724] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:03.027712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.028015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.028299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.049451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149363-d683-468e-b426-a1b4a3077174 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.068736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:03.069919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:03.102305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.103437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.104176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.104706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.116367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:03.118178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:03.143432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:03.144485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:03.145372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:03.145372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:03.145372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:03.145372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:03.151929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 372/725] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:03.152166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 354/726] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 04:59:03.153261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.175770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.200257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.264301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.338644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a76a5b-7e19-4ee9-85f8-d8b906e2cf8a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.341992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f39cd-2fef-4759-b760-3a18b696e393 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.408036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.408588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.408871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.409147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.409851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:03.410152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:03.411542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:03.414619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.415274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.415551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.415824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.427287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:03.433311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:03.434270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:03.435112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:03.440398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 373/727] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:03.442308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 355/728] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:03.448782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.449235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.564270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.587403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea231a-62fb-4c59-a6ee-239177b2414d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.621668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ff78-76df-4c12-8500-1fab0710e1cb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.623652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.624601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.625122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.625599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.633960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:03.636358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-c395ac91-7ddb-412f-b08b-55fb0fb7a430 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:03.648804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:03.649803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:03.650904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:03.652309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.653693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 356/729] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:03.659970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f308-d381-4428-910d-2c5081d305b2 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.660511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f308-d381-4428-910d-2c5081d305b2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.666986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f308-d381-4428-910d-2c5081d305b2 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.667169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.667276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 357/730] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:03.667352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.667423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f308-d381-4428-910d-2c5081d305b2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.667502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.668043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.669449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:03.669770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:03.671172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c6b6b-d8b2-475d-b486-052456a2bd00 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:03.681022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 374/731] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:03.687223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.687551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.687850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.714728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:03.715950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:03.794001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f308-d381-4428-910d-2c5081d305b2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.813794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 375/732] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:03.813794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.847632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:03.848296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:03.848579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:03.848855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:03.849653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:03.849963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:03.851463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:03.853359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.871796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 358/733] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:03.877147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:03.955712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a6a74-e729-48fe-9e98-529308dc9120 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:03.970079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:03.986581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33787-a01e-4d97-9487-7b07e168336a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.001235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.002051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.002535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.003012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.015460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.016959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.024700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.025280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.026126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.026753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.027207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.028611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a781f-6636-4a35-bcd5-88bc7c0beefd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:04.033006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:04.033902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:04.034839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:04.034839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:04.034839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:04.034839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:04.034839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 376/734] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:04.035128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.135716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 359/735] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:03 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:04.137095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83521-efb3-4706-9bc9-164b4499d8f0 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.137385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83521-efb3-4706-9bc9-164b4499d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.137661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f83521-efb3-4706-9bc9-164b4499d8f0 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.139250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 360/736] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:04.140768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f83521-efb3-4706-9bc9-164b4499d8f0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.147416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91a4b3-799e-4bb8-897c-82a6d093aab5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.200288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.201476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.201969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.202453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.218688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.241976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.272932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f83521-efb3-4706-9bc9-164b4499d8f0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.289156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.291108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.314735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.315367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.315648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.315941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.316645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:04.316949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.318817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862bdc6-50d4-4646-b4ce-1ea0e12ac033 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.334388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 361/737] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:04.334574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8759e-8df2-4537-95f0-35d559270ae8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.334742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8759e-8df2-4537-95f0-35d559270ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.335571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8759e-8df2-4537-95f0-35d559270ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.354610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-12b8759e-8df2-4537-95f0-35d559270ae8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:04.355930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-12b8759e-8df2-4537-95f0-35d559270ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:04.519143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 377/738] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:04.519143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.559836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 362/739] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:04.574124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534027-8d6a-471c-a2d7-8e29c281ecab None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.583204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534027-8d6a-471c-a2d7-8e29c281ecab None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.583204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534027-8d6a-471c-a2d7-8e29c281ecab None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.583204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 363/740] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:04 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:04.583204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534027-8d6a-471c-a2d7-8e29c281ecab None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.589207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.631838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.635966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f6a1-7540-40f6-9a0e-cf6b8055df45 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.674294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.675041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.675396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.675685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.685077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.686534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.695406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534027-8d6a-471c-a2d7-8e29c281ecab None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-733fe83e-ee4f-46d8-8b7f-60d68ec70ab7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:04.699408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:04.700448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 378/741] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.707336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.708231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.721187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:04.722390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:04.747418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.748219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.748570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.748919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.760611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.762043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:04.778105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:04.779033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 364/742] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:04.785359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.801388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 379/743] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:59:04.802275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.852524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.895723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:04.904251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553674-d261-41a9-a82d-a5684d2f16cd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.910076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8312-bd57-4a2f-a061-de1c286ed0b0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:04.940948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.941855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.942166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.942595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.948758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:04.949399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:04.949804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:04.950085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:04.951019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:04.951329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:04.952808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:04.953269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:04.958686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:04.959632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:04.960551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 365/744] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:04.961896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:04.982936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 380/745] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:04.982936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.072079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c265b-e941-4d24-bffc-b7458ff0eef3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.086560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d132-0fed-4b77-a15a-2d670e831ce3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.091123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.112574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.113278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.113564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.113885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.114574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:05.114878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.116271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.124568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.125189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.125513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.126182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.127239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.133378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.133521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 366/746] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:05.133521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.149757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.204192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 381/747] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:04 2022] POST /identity/v3/services => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:05.205200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.251241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6a9c-2b87-4ed1-beb9-f97ffb56ce4f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.332434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.333062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.333348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.333624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.334393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:05.334703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.337022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.352243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 367/748] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:05.353153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.355386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd731-6a6b-448a-b435-1966245ba821 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.407511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.408719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.408719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.408719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.448879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.460317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.492097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.493965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.500203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981c64b-2056-4ad7-a444-e725b20590af None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.545885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.546530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.546807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.547076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.556285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.558617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:05.574848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:05.575861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:05.577448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:05.579984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 368/749] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:05.581128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.622746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 382/750] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:05.624464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.686871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d004787-8e42-4ca7-a6c7-449efadd728b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.694644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.729462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.734497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.735142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.735419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.735689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.745118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1e7f-4b72-461a-afb4-ea1d4cfe9d45 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.748469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.749391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:05.766972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:05.767985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:05.768904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:05.768904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:05.768904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:05.768904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:05.772779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 369/751] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:05.773655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.793981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.794608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.794889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.795163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.796094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:05.796415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.798287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.815732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 383/752] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:05.817045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.911886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e9d5-b5c5-4f6d-8f28-32f4ad25d9e5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.931687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba4c49-0e3b-4820-985a-0218b5eedb5e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:05.957830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:05.960560 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.961389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.961678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.961955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.970835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:05.972021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:05.972504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:05.972987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:05.981535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:05.981535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.981723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:05.981801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.981873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:05.990011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 384/753] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:05.991258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:05.995626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:05.996714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:05.998235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:05.998235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:05.998235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:05.998235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:05.999984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 370/754] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:06.001051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.048751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.123816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b607-2e54-4516-8637-277548bdcb23 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.128540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25f43-e354-41e8-8522-0bb346f77188 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.168471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.169730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.170230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.170707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.171748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=08b0d11d73184d26987ce4bdbfe05514) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:06.172317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.174129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.181504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 385/755] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:05 2022] GET /identity/v3/role_assignments?user.id=08b0d11d73184d26987ce4bdbfe05514&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:06.182791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.288777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.326723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa57a-ee66-4916-b5bf-36d41067cfd2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.362399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.363058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.363341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.364101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.369704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.370925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.371422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.371943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.372887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:06.373006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.373604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.374425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.375668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ae02b-004c-4af7-b65d-c2133fba881a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8de9b323-093b-4381-9222-6ae550235d56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:06.388350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:06.389557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:06.391188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 371/756] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:06.391792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160393e-6fc0-4750-95a2-ddff790a689a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.391862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160393e-6fc0-4750-95a2-ddff790a689a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.392160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160393e-6fc0-4750-95a2-ddff790a689a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.393753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 372/757] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:06.394478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 386/758] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:06.404070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160393e-6fc0-4750-95a2-ddff790a689a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.404289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.404289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.404289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.425263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:06.426724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:06.511544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.519141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160393e-6fc0-4750-95a2-ddff790a689a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.527868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 387/759] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:06.528974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.581076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.581857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.582234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.582605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.583507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:06.584068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.584271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.585858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.606781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 373/760] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:06.607887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.666626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7feeb4-003f-47c1-ae42-47aaf412c4b7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.717315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.718475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.719248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.719879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.722005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c01ead-95d5-4506-8504-676ff357111c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.729114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.731429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:06.747958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:06.748929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:06.749828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:06.751115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 388/761] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:06.751789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.771098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.772158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.772625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.773171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.775221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.777674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:06.790067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:06.791129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:06.792004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:06.794914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 374/762] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:06.796087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.828363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.863421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:06.867165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570933d-a997-49cc-86e7-4501b132cbf7 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.905149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.905965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.906451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.906829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.907585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e8a6-1099-4b29-86db-5620ac7da2aa None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:06.919399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.921116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:06.937484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:06.938482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:06.939716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:06.939716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:06.939716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:06.939716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:06.939716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 389/763] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:06.940846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:06.952392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:06.953293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:06.953723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:06.954143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:06.955251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:06.955706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:06.957425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:06.973013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 375/764] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:06.974207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.082281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b780-81c0-48b8-9210-1b2befa77edf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.085329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.111980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abd87-483d-485b-9956-fbe3db894953 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.126639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.127668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.128208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.128797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.129684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.130210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.131793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.137937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 390/765] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.139111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.151634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.152289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.152570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.152843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.153545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.153841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.155319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.158460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.171054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 376/766] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.172496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.257957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9add-65e7-4fa9-a6a4-1a018d0b4044 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.290249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa0f15-5ad4-407f-be9b-b1eeac53150b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.294395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.295174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.295620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.296025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.296925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=568b6aa97ee74544a6a87ad063938d43) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.297339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.298943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.311995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 391/767] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/role_assignments?user.id=568b6aa97ee74544a6a87ad063938d43&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.313207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.342957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.343939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.344398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.344810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.345667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.346188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.347719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287595a-1185-4dc9-8d7c-b18074c47bcf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.361796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 377/768] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.363255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e27a-312c-4f90-bf7a-f8b31c18f74f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.363538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e27a-312c-4f90-bf7a-f8b31c18f74f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.363818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e27a-312c-4f90-bf7a-f8b31c18f74f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.368070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 378/769] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:07.369682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7e27a-312c-4f90-bf7a-f8b31c18f74f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.389050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.420310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.450222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07623612-5094-4bfc-96b2-787e7f4ca39f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.502499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.503158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.503521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.503923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.505106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7e27a-312c-4f90-bf7a-f8b31c18f74f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.513952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.515164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-05115e47-8927-4d69-8b0f-2f946c476182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:07.530359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:07.531335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:07.532758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 392/770] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:07.533856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.534150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.534431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.554952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.556445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.557641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.558270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.559254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] RBAC: Adding query filter params (interface=public, service_id=95648006d8f04a26b85f8a3de8d31496, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.559773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.560550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:07.561612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.561814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:07.570333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 379/771] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/endpoints?service_id=95648006d8f04a26b85f8a3de8d31496&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.571601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.639285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.660669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 393/772] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:07.662216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.705010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9e9e-5029-493d-bbb4-e1724ef9ee85 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.751170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.754736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.756458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.756946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.757417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.758363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:07.758848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.767324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.783127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 380/773] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.783127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.795712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68426d-52bc-4cc6-a7d3-f5c206394ce9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.834382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.834727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.835009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.835329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.836211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.837608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.844782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 394/774] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:07.845675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:07.927519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deedc5-79ef-4718-bd4a-adce6024a1e5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.957642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:07.968213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:07.973128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:07.973128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:07.973128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] PATH_INFO: `/v3/services/network` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:07.973128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:07.973128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:07.982390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:07.983612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:07.984577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:07.986275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e541b-9c77-41f0-bf2f-434496134f36 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:07.988207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 381/775] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:07.990289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:08.024921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:08.031224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:08.032150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.039074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.039074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.039074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=55b281089b494473a7b58228ac75c898, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:08.039074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:08.114420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd46c43-c210-4e6b-adc8-d2e887ea3290 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:08.131522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 395/776] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:07 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:59:08.157314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:08.158384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.158869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.159387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.160448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:08.161012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:08.162648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:08.170503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 382/777] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:08.176240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:08.313530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fd10f-711b-44ef-91af-533b65201521 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:08.366449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:08.367517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.368057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.368558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.370214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] RBAC: Adding query filter params (type=network) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:08.370731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:08.372417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:08.382225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 396/778] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:08.389023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:08.474140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:08.526464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0560-579a-4205-a6c2-533510b984c6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:08.566829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:08.567430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.567660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.567947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.568703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] RBAC: Adding query filter params (interface=public, service_id=9989c5e767fc45468458a3391d1b7af0, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:08.569011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:08.570463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e51b1-f8af-42d4-b35d-165c8e2777ce None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:08.577402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 383/779] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:08 2022] GET /identity/v3/endpoints?service_id=9989c5e767fc45468458a3391d1b7af0&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:08.583230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:08.677832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:08.733533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bda9-f4a1-416c-b8f4-a04a09e75d2f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.733820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bda9-f4a1-416c-b8f4-a04a09e75d2f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.734189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bda9-f4a1-416c-b8f4-a04a09e75d2f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.735810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 384/780] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:08.739785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa7d24-f66e-4be9-b694-aa78a833dfbf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:08.753350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.753625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.753907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.783479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:08.784844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:08.785272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:08.785691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:08.786487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:08.788030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:08.792419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:08.793983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:08.795855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 397/781] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:08 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:08.894711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 385/782] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:08.927891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:09.070085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0501aa6-1a32-4503-89a6-53e40fa3cb91 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:09.091654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:09.108065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:09.108773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.109116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.119219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.120562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:09.125621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:09.127055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:09.128774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 398/783] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:09.136512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:09.191186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:09.249162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c764-68a8-4d17-a27b-37acb624385d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:09.287687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:09.288394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.288678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.288952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.289677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:09.289981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:09.292032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:09.301562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 386/784] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:09.309113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:09.430791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82936a-a512-47f6-bd73-f9cd3e373a8d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:09.478039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:09.479293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.479885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.479885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.492785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:09.494277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:09.516188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:09.518251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:09.520508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:09.520508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:09.520508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:09.520508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:09.520508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 399/785] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:09.525185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:09.647193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac190a5-6efd-4d6f-b8f7-72f680d5ff8e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:09.658561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:09.684015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:09.684698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.684982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.685304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.686012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:09.686320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:09.687690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b064b-bebe-4b3c-9d22-e966705e71eb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:09.701895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 387/786] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:09.711340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:09.766977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:09.805946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2a8a-3978-447b-8c87-d70d9f214653 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.806274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2a8a-3978-447b-8c87-d70d9f214653 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.806492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe2a8a-3978-447b-8c87-d70d9f214653 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.808263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 388/787] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:09.813812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.814114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.814356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.846285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:09.847497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:09.889902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdac6-31a1-4bbc-908b-6758a8c92f03 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:09.978372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:09.979786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:09.980029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:09.982748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:09.982931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 389/788] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:09.991511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:09.993069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:10.005558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:10.007559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:10.009618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 400/789] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:10.017828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.019531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.130962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.134554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55ec03-b285-42ba-8892-dff8e3d6e984 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.174283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.174909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.175237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.175517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.177364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:10.177700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.179144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.201117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 390/790] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:10.214158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.230991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.241926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734392b5-860a-420a-872e-27ee6d76b9ed None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.283473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.284868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.285304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.286027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.300423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:10.307438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:10.308543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:10.309518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:10.312528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 401/791] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:10.318347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.399787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4df80-0c61-4a60-858c-661bc5fee3a0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.449008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.449914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.450345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.450773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.466164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.468668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.487605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661364-f873-4705-b772-fcdedbbd6b03 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-64f6390e-1f89-445f-8cb1-c82e8d2ed322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:10.489428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:10.490472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:10.491513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:10.491513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:10.491513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:10.491513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:10.497734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 391/792] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:10.497734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24793-7cbc-48cf-a0fb-d317ca79ca84 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.497963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24793-7cbc-48cf-a0fb-d317ca79ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.498207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee24793-7cbc-48cf-a0fb-d317ca79ca84 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.499529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 392/793] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:10.504416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee24793-7cbc-48cf-a0fb-d317ca79ca84 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.518484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.548263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.549262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.549759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.550359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.552185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:10.552704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.554271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad46d7-9fb0-4075-9641-2bc95b0e1410 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.567774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 402/794] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:10.569787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.570267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.570691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.596754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:10.598220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:10.611725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.627159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee24793-7cbc-48cf-a0fb-d317ca79ca84 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.665016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.665803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.666448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.666850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.667695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:10.668236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.669913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.687445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 393/795] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:10.687445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.694405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 403/796] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:10.695595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.799097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.834724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449c33-1012-40d6-b7c7-29576cd1dcff None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.836419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ded35-9902-42a8-961e-e0abcd73aece None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:10.879120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.879483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:10.879760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.880071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.880904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.880995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.881068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.881068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.888305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.890326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.894994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:10.896661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:10.903779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:10.904783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:10.906142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:10.908236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 404/797] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:10.909845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:10.914322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-81882aa6-9116-43a6-8e98-53c500577553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:10.917781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:10.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:10.921270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:10.921270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:10.921270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:10.921270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:10.924078 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 394/798] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:10.925440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec17a3-6edc-4c74-84d4-85ade2c08073 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:10.925718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec17a3-6edc-4c74-84d4-85ade2c08073 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:10.932168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec17a3-6edc-4c74-84d4-85ade2c08073 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:10.932168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 395/799] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:10.932168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec17a3-6edc-4c74-84d4-85ade2c08073 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.043035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17360500-bc0b-419d-bdca-9ee1d1d3679d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.046809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec17a3-6edc-4c74-84d4-85ade2c08073 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.075974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.084393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.085112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.086049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.086049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.088478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.088478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.092183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.093240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.093240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.093520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.096302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:11.096302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.096302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984b15b-faad-4fe9-ad1e-c1fb4dd2cae2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:11.098676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:11.099615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:11.100518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 405/800] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:11.101362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.118274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 396/801] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:11.120067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.120351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.120723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.141290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:11.142508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:11.190689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.231475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 397/802] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:11.232209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.235190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3011-bb05-4707-b446-a9a85c776c07 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.279483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.280278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.280627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.280950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.281725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:11.282113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.283960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.298194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 406/803] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:11.299110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.367960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd1ac-1f25-4098-ad0c-e75ddf137fe5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.384171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.409879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.410494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.410773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.411045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.411730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:11.412062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.412616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126aec-95f5-4586-8490-c97e3dee4db6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.413457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.418799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 398/804] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:11.419606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.444052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.452335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.453014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.453300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.453576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/08b0d11d73184d26987ce4bdbfe05514/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.455656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=08b0d11d73184d26987ce4bdbfe05514, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.457146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.524261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47a9b4-96de-4b3a-8a51-fade22388657 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.559848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.560502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.560800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.561054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.565658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 407/805] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:11 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/08b0d11d73184d26987ce4bdbfe05514/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:59:11.566504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.572446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-515eb39e-7888-4108-8df4-fa0370f6aad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:11.577862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:11.579093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 399/806] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:11.581368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50e2f-7c2e-4338-ab9b-d16b7c92b960 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.582888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50e2f-7c2e-4338-ab9b-d16b7c92b960 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.582888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50e2f-7c2e-4338-ab9b-d16b7c92b960 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.584403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 400/807] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:11.585829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd50e2f-7c2e-4338-ab9b-d16b7c92b960 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.634788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.722953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387545c-fad8-4dfa-9ee6-b953a4d695a8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.735440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd50e2f-7c2e-4338-ab9b-d16b7c92b960 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.768583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.769587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.769877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.770156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.781615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.784427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.787944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.789406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.789406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.789702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.790173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:11.790480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.792463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.798423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 401/808] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:11.799134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-5fde6c13-1a0b-4415-bcfb-d9772a5a07c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:11.800964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:11.801892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:11.802832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 408/809] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:11.803675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.804733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.804733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.822984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:11.824683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:11.879831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.920043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 409/810] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:11.920043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:11.937945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:11.940963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e2a7-cf0f-4aa4-8e9f-a71c87873790 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:11.979928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:11.980827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:11.980827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:11.981100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:11.981849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:11.982159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:11.983535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:11.997940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 402/811] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:11.997940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.073243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ccae6-ce0f-4007-a4cb-65b585b07415 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.117427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.118583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.119125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.119591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.120620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.122210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.122337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491d912-25ff-46f5-a108-5e53e816a7dd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.167992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.168962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.169207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.169474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.170318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:12.170567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.172017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.190017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 403/812] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:12.190850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.218328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:12.226769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 410/813] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:12.229187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.270939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:12.380069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6051-257e-4aec-98d3-6f724ffa3863 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.402491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4883-f11a-48e6-97c8-36e83acee369 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.446199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.446765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.447043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.447368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.451031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.452181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.452932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.453685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.455658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.460589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.462319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.462641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:12.481422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:12.482493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:59:12.483326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:12.485990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 404/814] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:12.486978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:12.492000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:12.492921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:12.493824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:12.493824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:12.493824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:12.493824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:12.493824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 411/815] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:12.499564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.652651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:12.677867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6761-5227-4b3f-a7b0-6d26ded3b3aa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.710639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:12.747188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0ba39-1676-498a-8b6f-a96838800ce9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:12.758592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.759232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.759517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.760379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.761075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:12.761388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.762780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.778194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 412/816] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:12.779235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.831635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:12.832332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:12.832621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:12.832897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:12.847737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:12.849384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:12.865518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:12.866510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:12.867412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:12.867412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:12.867412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:12.867412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:12.874111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 405/817] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:12.874111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:12.958537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1398d64-5139-4265-a6da-761938b8c9a2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.003150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f745c-3ec9-4f97-bb77-260f7e1860f7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.006086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.006997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.007504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.008015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.008922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:13.009446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.011762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.026338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 413/818] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:13.027640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.037533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.044581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.045453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.045902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.046443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.047356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:13.047925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.049672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.052247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.060322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 406/819] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:13.061428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.156733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52379b0-ad58-4eea-9516-622cada2b7c6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.197302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fea2aa-d349-40c2-8235-ae2cdca867f9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.203797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563402f3-00e3-4379-9455-749006521828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.204589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563402f3-00e3-4379-9455-749006521828 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.204973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563402f3-00e3-4379-9455-749006521828 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.205357 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563402f3-00e3-4379-9455-749006521828 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.206155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563402f3-00e3-4379-9455-749006521828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:13.206567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563402f3-00e3-4379-9455-749006521828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.208516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563402f3-00e3-4379-9455-749006521828 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.229252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 414/820] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:13.230603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563402f3-00e3-4379-9455-749006521828 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.241594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.242201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.242590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.243020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.252831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.254509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:13.267842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:13.268870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:13.269818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 407/821] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:13.271129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.309952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.339030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.351791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563402f3-00e3-4379-9455-749006521828 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.388232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6246-2f1e-4fbf-8747-3373c686c0d6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.391020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.391844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.392366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.392822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.393824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.395387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.425588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.426235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.426541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.426801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.434689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.436226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:13.448611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:13.450182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 408/822] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:13.451134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.489900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 415/823] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:13 2022] POST /identity/v3/endpoints => generated 337 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:13.491117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.668073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129d3c2-fee7-45a9-9bc9-26c5aed33d72 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.700506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.724209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.724850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.725133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.725405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.726204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:13.726516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.728069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64cb05-e383-4ada-9e63-26f37c9f1f5e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.730796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23bdc1-8e53-4ff1-8344-07fe43bc2fa3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.753432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 409/824] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:13.754719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33e53-8e84-43e8-bc98-9d209f7a3675 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.755011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33e53-8e84-43e8-bc98-9d209f7a3675 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.755284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33e53-8e84-43e8-bc98-9d209f7a3675 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.757253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 410/825] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:13.762440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab33e53-8e84-43e8-bc98-9d209f7a3675 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.762932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.779304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.780812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.781372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.781815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.792788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:13.792788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.792788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbfa70-f894-404d-8c09-454b17030781 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:13.800021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 416/826] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:13.801614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13890-8188-4632-8142-327248166c6f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.802131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13890-8188-4632-8142-327248166c6f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.802631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13890-8188-4632-8142-327248166c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.822437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c6a13890-8188-4632-8142-327248166c6f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:13.823682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c6a13890-8188-4632-8142-327248166c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:13.875953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab33e53-8e84-43e8-bc98-9d209f7a3675 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:13.900947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 417/827] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:13.901990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13890-8188-4632-8142-327248166c6f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:13.919959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:13.920684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:13.921059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:13.921404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:13.968582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:13.994827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:13.996327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.021445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13890-8188-4632-8142-327248166c6f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.037732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.062409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.063127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.063410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.063690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/568b6aa97ee74544a6a87ad063938d43/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.080244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=568b6aa97ee74544a6a87ad063938d43, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.081719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.104710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 411/828] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:14.105587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.170054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 418/829] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:13 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/568b6aa97ee74544a6a87ad063938d43/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:59:14.171477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.199171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.230574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e93c-96aa-4d07-b341-201a788a1987 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.273892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.274477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.274754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.275024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.288484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:14.295397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:14.296459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:14.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:14.301740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 412/830] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:14.303509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.330490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c741ac-a288-4e21-a925-825f8b70dd1b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.382025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.382711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.382996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.383274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.397005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.398724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:14.414721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:14.416337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:14.417353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:14.417353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:14.417353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:14.417353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:14.417353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 419/831] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:14.424382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.428446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe35f6f-f0b2-4e8b-b4b3-7fab724b18a2 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.449039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.467412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.472048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb030e9-3ea2-4a6a-92ad-9e7c0d173253 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.473119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.482424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 413/832] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:14.483874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca98f9-438a-4e64-9fcd-4e0ddfd02695 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.484195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca98f9-438a-4e64-9fcd-4e0ddfd02695 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.484473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca98f9-438a-4e64-9fcd-4e0ddfd02695 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.486789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 414/833] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:14.488401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca98f9-438a-4e64-9fcd-4e0ddfd02695 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.550157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b580fb-3971-4a0e-b108-0a0e562df5d8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.590378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.591006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.591289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.591570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.592296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:14.592605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.593981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8388fc-4b27-4be2-a432-06bd8ac13c90 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.601629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca98f9-438a-4e64-9fcd-4e0ddfd02695 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.611019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 420/834] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:14.611019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.611019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.611019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.627080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:14.628320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:14.643315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.643973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.644258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.644528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.657288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.658748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:14.674878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:14.676068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 415/835] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:14.676995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.723996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 421/836] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:14.725272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.729882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.740031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.799080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97f87e-9a88-4eef-bc1f-2f53f1b221ac None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.834448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.835087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.835374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.835652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.839512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe288d-708c-4036-8b6d-09aedffd8293 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.843403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.844893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:14.858426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:14.859382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:14.860341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:14.864550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 416/837] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:14.865611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.879881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:14.880545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:14.880828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:14.881101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:14.881793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:14.882215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:14.883698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:14.901430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 422/838] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:14.902336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:14.973296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:14.978103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826148-bbce-41f0-8f66-1f0a233e8ef5 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:14.989681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.018620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab401c-8900-4425-85d3-56acc191efdc None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.019193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.019942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.020407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.020619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.021309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.025794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:15.036889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:15.038017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:15.038900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:15.048522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 417/839] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:15.049861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.064235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.064880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.065140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.065416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.066166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:15.066475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.067935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.085769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 423/840] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:15.085769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.163517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0dd56-44af-4bbe-80fb-aabf50c3eedf None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.189633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3755d-e5c6-4287-b1cd-c5eb44183b0f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.214935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.215634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.215977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.216232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.216906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.224442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.225884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.226730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.227349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.227629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.227921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.229343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:15.229651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.234147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.240243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 424/841] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:15.240243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:15.240443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:15.241590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 418/842] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:15.242588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.278922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.356664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3da5-44a5-4da1-9c23-6fac8e4ee39e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.360134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c8173-eb43-46f0-b72d-bb2a365e7283 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.394841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.395490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.395774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.396078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.396878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:15.397193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.398338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.398640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.399159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.399538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.399935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.401334 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:15.401797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.403270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.405946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 425/843] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:15.406652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.415347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 419/844] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:15.469520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.530516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7be54d-52f7-4e3c-8a4e-5b6c42fabbd0 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.573350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.573999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.574284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.574558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.575384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:15.575694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.577323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.599566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 426/845] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:15.606127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:15.729328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.736525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e0f06-daa4-46ef-8352-5836912f744b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:15.772446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:15.773075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:15.773361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:15.773641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:15.850885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:15.853778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:15.955224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.963457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 420/846] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:15.968821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.073745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989bec-342e-47e3-969f-265e2354e045 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.086302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.111778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.112453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.112732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.113005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.124805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.126287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-51b5f374-d4f9-4a3f-865f-d3bbdc129fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:16.142730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:16.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:16.145164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:16.145164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:16.145164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:16.145164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:16.145164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 427/847] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:16.149533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.252890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fead2-cd46-4a0f-9e6d-b9771453657c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.288368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.288991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.289557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.289827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.290518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:16.291039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.292949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.305302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 421/848] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:16.311379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.311936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94a144-909d-4677-9151-68e34054211d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.312224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94a144-909d-4677-9151-68e34054211d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.312502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94a144-909d-4677-9151-68e34054211d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.314102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 428/849] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:16.319180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.319467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.319749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.338942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:16.340259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:16.378286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.416548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 429/850] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:16.431009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3232fe-bcbd-471e-97b0-ae7660dc7d33 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.437082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.474083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.474722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.475000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.475270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.484526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.486539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:16.502468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:16.503675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:16.505014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:16.507990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 422/851] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:16.511321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.547636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a632-e235-4518-8127-b196c40dcc32 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.585569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.586264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.586552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.586935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.588983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.602375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:16.607758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:16.608836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:16.610121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 430/852] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:16.615436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.640708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa473571-b7f7-4b88-aec3-08cc3136695a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.660935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.681797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.682836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.683268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.683740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.684919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:16.685377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.686975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.702916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 423/853] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:16.711397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.740316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490683a-e7c2-47b0-aa75-c56eeac62e79 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.789223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.790427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.790978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.791616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.792740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:16.793262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.795885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.807538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 431/854] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:16.812807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:16.833668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:16.836468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db2f1-5a32-4a64-a596-8160d498bb19 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.878812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.879458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.879738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.879992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.880788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=08b0d11d73184d26987ce4bdbfe05514) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:16.881100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:16.882588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:16.896149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 424/855] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/role_assignments?user.id=08b0d11d73184d26987ce4bdbfe05514&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:16.945760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214a39-f1cf-4258-9694-048a2b13ec45 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:16.985086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:16.985749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:16.986029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:16.986302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:16.999875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.001480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:17.018472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:17.019441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:17.020380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:17.020380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:17.020380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:17.020380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:17.020380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 432/856] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:17.025788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.073616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.140216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d86d6-f13c-4434-91a5-6be2e79f1102 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:17.176256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:17.176874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.177147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.177419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.178171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:17.178473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.179899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:17.193347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 425/857] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:17.199525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.271894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.309794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdefdb5-2151-465c-a630-b0482d516dcb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:17.347456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:17.348075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.348423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.348703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.357599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.359187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:17.372118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:17.377769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:17.378719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 433/858] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:17.379464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.487786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.491545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0165-b270-4cf5-9941-f87449b28b9d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:17.528157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:17.529064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.529495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.529918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.530864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:17.531327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.533049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e459dfc-5da7-4647-9ed6-c943b53849f8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:17.560080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 426/859] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:17.569135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.603707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387b2a-1dff-4d4f-a779-3ddafd7201f4 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.604313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387b2a-1dff-4d4f-a779-3ddafd7201f4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.605119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b387b2a-1dff-4d4f-a779-3ddafd7201f4 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.607163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 427/860] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:17.613800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3772-5ada-44ee-910a-09a707ed8916 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.614255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3772-5ada-44ee-910a-09a707ed8916 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.614676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d3772-5ada-44ee-910a-09a707ed8916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.639676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-479d3772-5ada-44ee-910a-09a707ed8916 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:17.641872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-479d3772-5ada-44ee-910a-09a707ed8916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:17.686855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ec9e7-a676-4fa8-a804-d1c34f637a92 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:17.719225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.735011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 428/861] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:17.735011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805d4f-eda6-44a8-b10e-c2ade971663d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.735011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805d4f-eda6-44a8-b10e-c2ade971663d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.735011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04805d4f-eda6-44a8-b10e-c2ade971663d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.735011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 429/862] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:17.736334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:17.736569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.736859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.736961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.737135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.737235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.737509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.755544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:17.756780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:17.819704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.821249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:17.827696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 430/863] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:17.829535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.849216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.930206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 434/864] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:17.932122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:17.948952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b956-822d-405f-95cb-c33c0944d102 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:17.960563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:17.987323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:17.988366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:17.988795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:17.989219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:17.990078 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:17.991691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.034315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c490a-6d36-4080-bfb0-6e58a7944509 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.075968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 431/865] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:17 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:18.075968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.088695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.090407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.091081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.091692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.092673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.095508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:18.109917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:18.111136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:18.112231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:18.121364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 435/866] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 04:59:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:18.123357 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.185957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:18.219712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a218-0bcf-42d8-b83a-7349c4f172ef None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.242399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:18.265891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e142-1bf9-4e1f-ab2f-375f5a4d2b32 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.271450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.272134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.272419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.272696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.288051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.289348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:18.306538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:18.307520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:18.309178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:18.309178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:18.309178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:18.309178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:18.309178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 432/867] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:18.313762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.315286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.316925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.316925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.316925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.317171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:18.317974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.319043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.333717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 436/868] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:18.335301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.454625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a646e8-c798-4599-81eb-22fb1b126a87 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.458777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4b374-f0f0-49bb-86cf-b0d51b5caf9e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.491476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.492127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.492412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.492693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.493380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:18.493687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.496051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.501973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 437/869] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:18.502307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:18.517039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.517950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.518378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.518872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.519827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:18.520373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.521999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.537666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 433/870] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:18.543993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.563381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:18.664480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5854-08b7-463e-bef2-5c0c52eeba97 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.710228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.711166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.711653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.712178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.720344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.722881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:18.736326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:18.737258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:18.738144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:18.740572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 438/871] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:18.746772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:18.858855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1a26-c3d9-4866-9475-562255c7a262 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:18.898449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:18.899417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:18.899929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:18.901563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:18.902549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:18.903055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:18.904740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81976237-ece1-40f2-ad64-224afa26c2a3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:18.918113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 434/872] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:18.924557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:19.005160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:19.031452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2be65-3522-462a-8fb9-c09a0a8359e2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:19.067375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:19.068020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.068302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.068573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.069373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=568b6aa97ee74544a6a87ad063938d43) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:19.069683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:19.071117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f360-eb1e-4798-99af-83e2235d7105 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:19.078224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 439/873] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:18 2022] GET /identity/v3/role_assignments?user.id=568b6aa97ee74544a6a87ad063938d43&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:19.115330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cefb1-5133-4641-bd0a-c9a4af16165d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.115853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cefb1-5133-4641-bd0a-c9a4af16165d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.115853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cefb1-5133-4641-bd0a-c9a4af16165d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.117597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 435/874] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:19.123742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.124074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.124334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.144587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:19.145940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:19.224341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 440/875] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:19.254755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cefb1-5133-4641-bd0a-c9a4af16165d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:19.337426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:19.433079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cefb1-5133-4641-bd0a-c9a4af16165d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:19.494142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:19.495224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.495725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.496258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.497506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:19.500311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:19.518162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:19.519174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:19.520051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:19.520793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 436/876] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:19.527882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:19.603768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:19.639474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477cf10-f28e-43a4-aa27-8d5828280ebf None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:19.680155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:19.681026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.681631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.682201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.683035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:19.683521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:19.685077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8bd8-3bc9-44fe-a4b4-6899306abb5c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:19.690617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 441/877] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:19.697369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:19.810328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35980e-3d72-40ce-860b-f5c9465ce7eb None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:19.826071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:19.849279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:19.854845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c115f2-a092-45ce-b653-906b934181a1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:19.861323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 437/878] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:20.319222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483462cc-5b08-4f06-83f6-a114f82e66bd None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.319652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483462cc-5b08-4f06-83f6-a114f82e66bd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.320056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483462cc-5b08-4f06-83f6-a114f82e66bd None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.328805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 442/879] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:20.328940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.328940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.328940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.348750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:20.349971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:20.427458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 438/880] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:20.451963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483462cc-5b08-4f06-83f6-a114f82e66bd None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:20.562345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483462cc-5b08-4f06-83f6-a114f82e66bd None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:20.596147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:20.601644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:20.602299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.602580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.602853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.603585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:20.605202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-17a4340a-23b5-407f-bd39-58c20da7c894 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:20.615098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:20.617548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:20.620422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 443/881] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:20.627938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:20.677855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f59ff-480b-4252-a476-2c6e46af0b05 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.678181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f59ff-480b-4252-a476-2c6e46af0b05 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.678410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f59ff-480b-4252-a476-2c6e46af0b05 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.684020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 444/882] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:20.685738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.686025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.686308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.716887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:20.718355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:20.745638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e307199-f7de-4f8c-b49d-c3471231a029 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:20.756226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:20.783975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:20.784935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.785404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.785837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.786677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:20.787152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:20.788742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:20.797685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 439/883] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:20.803160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:20.815252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 445/884] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:20.834470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:20.924468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8222c40-ea07-49f8-84db-d2c1064157db None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:20.954278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f459-aa05-4631-91c5-a9faab35c131 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:20.971949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:20.973223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:20.973747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:20.974637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:20.975547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:20.976083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:20.978450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:20.984094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:20.992186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 440/885] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:20.994549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:21.000888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.001543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.001827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.002124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.002867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:21.004425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:21.037486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:21.072951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 446/886] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:20 2022] POST /identity/v3/services => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:21.124879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0c3-2468-4457-9566-545c95b575ce None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:21.174970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.175987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.176475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.177018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.178242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] RBAC: Adding query filter params (interface=public, service_id=9c546a7bc4da4a2f8f5f050f27261a75, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:21.178840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:21.180607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d2e9-db8b-48ee-928f-b5e6782965f5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:21.188278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 441/887] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:20 2022] GET /identity/v3/endpoints?service_id=9c546a7bc4da4a2f8f5f050f27261a75&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:21.194550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:21.316641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a910b-8982-4ea9-bf1c-35bc3249f288 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:21.338694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f112302-2ec4-40b4-b560-7c5d682f9174 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.339372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f112302-2ec4-40b4-b560-7c5d682f9174 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.339372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f112302-2ec4-40b4-b560-7c5d682f9174 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.342003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 442/888] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:21.346298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.346584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.346864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.364937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.366071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.366583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.366847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:21.367288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.368086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:21.368443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:21.370603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:21.379013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 447/889] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:21 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:59:21.456533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 443/890] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:21.480273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:21.539097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:21.597265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292567a7-e075-4488-b8c0-688a4a797063 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:21.635180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.636255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.636759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.637247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.648739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:21.654699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:21.655753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:21.656672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:21.659427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 448/891] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:21.665087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:21.695285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:21.780475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731815-6be6-4759-bc1b-f42374cd7e8e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:21.818936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.819937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.820431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.820948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.821929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:21.822514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:21.824315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3f212-4d3d-4d98-bb41-467b894c5168 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:21.833768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 444/892] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:21.841267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:21.936704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcea58-582d-45a0-a503-b78bba0459d0 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.937166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcea58-582d-45a0-a503-b78bba0459d0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.937284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcea58-582d-45a0-a503-b78bba0459d0 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.938864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 445/893] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:21.944074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.944365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.944649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:21.956525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc5dc-abb9-41ff-8c71-dbd6f4adb428 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:21.969828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:21.972381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:21.974375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:21.995040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:21.995839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:21.996253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:21.996633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.008507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.010602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:22.029695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:22.030736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:22.031658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:22.031658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:22.031658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:22.031658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:22.031658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 449/894] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:22.036812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:22.076105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 446/895] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:22.096861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:22.119592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:22.167797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81dd0-4e63-4c74-8f54-7069b203b41b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:22.215569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:22.216433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:22.216824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:22.217464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.218715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:22.219181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.220862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.225940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e85a1-0f73-43f3-9990-6254b3226d75 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:22.241789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 450/896] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:22.243304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:22.271350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:22.274566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:22.275931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:22.276342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:22.276796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.277773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.279285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.352110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 447/897] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:22 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:22.368220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173d0a5-3c5a-4bda-b368-aaf57ac07dc4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:22.422857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:22.423626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:22.424043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:22.424313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.433142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.434649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:22.450335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:22.451366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:22.452364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 451/898] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:22.459331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:22.557806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:22.584567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00ba5a-d285-46af-8f1b-6a4a55d4b65e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:22.628650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:22.629271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:22.629550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:22.629826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.630629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:22.630933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.632408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.653402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 448/899] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:22.659083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:22.749585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:22.772932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe0f0-faec-4089-bacc-b1ad3ba86168 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:22.810985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:22.811611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:22.811889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:22.812192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:22.887227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:22.888641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:22.974055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:22.999072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 452/900] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:23.009046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.121172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e365edf-e11f-48f3-8f5f-13b0e51a721c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.157895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.158465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.158748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.159026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.162017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.171648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.173154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-380c2387-af97-4778-9729-12283958c3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:23.189383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:23.190300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:23.191206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:23.191206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:23.191206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:23.191206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:23.191206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 449/901] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:23.201054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.310421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e986-20bf-4b2d-ab42-e1807cec1247 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.310774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e986-20bf-4b2d-ab42-e1807cec1247 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.310978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e986-20bf-4b2d-ab42-e1807cec1247 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.311712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46cfc-bcf3-4780-ac43-afb2779659bf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.312589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 450/902] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:23.317929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.318178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.318427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.337736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:23.339653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:23.348622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.349255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.349538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.349811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.350656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:23.350962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.352479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.366052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 453/903] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:23.372413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.427570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.428569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 451/904] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:23.445966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.508968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493452-f554-4c70-ac52-2757916cdc6b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.559848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.560515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.560796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.561062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.570124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.570759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694e92-c206-485a-9e3d-abafe5dcf5c6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.571649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-64510dab-8758-4d81-b637-134bed9b1e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:23.585274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:23.586273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:23.587206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 454/905] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:23.588768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f9c5-a8a8-4e8e-89ce-e641d65427e9 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.589050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f9c5-a8a8-4e8e-89ce-e641d65427e9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.589325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f9c5-a8a8-4e8e-89ce-e641d65427e9 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.591956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 455/906] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:23.592206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87f9c5-a8a8-4e8e-89ce-e641d65427e9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.598854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.620318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.620979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.621260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.621535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.622176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.623564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-174cb46e-4ef4-452f-ae25-85707af73d85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:23.633998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:23.635076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:23.641851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 452/907] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:23.642746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60764ea-9e3d-483f-803d-c587686820df None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.642746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60764ea-9e3d-483f-803d-c587686820df None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.642746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60764ea-9e3d-483f-803d-c587686820df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.656174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-a60764ea-9e3d-483f-803d-c587686820df None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:23.657390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a60764ea-9e3d-483f-803d-c587686820df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:23.706488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.712066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87f9c5-a8a8-4e8e-89ce-e641d65427e9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.734022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 453/908] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:23.734703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60764ea-9e3d-483f-803d-c587686820df None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.757937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.759052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.759557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.759861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.760615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:23.760920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.762804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.775548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 456/909] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:23.780633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.858631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60764ea-9e3d-483f-803d-c587686820df None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.872327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.888380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f602-5cb4-4afb-aded-270e29e302d4 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:23.895087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.896141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.896431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.896953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.898052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:23.898366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.900182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.909665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 454/910] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:23.909665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.930122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:23.930764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:23.931045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:23.932036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:23.932673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:23.934046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:23.943118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:23.945154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:23.946014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 457/911] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:23.946969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:23.972042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.020941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0866-83ab-4bb2-96fc-7b5ec9b649a0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.055722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd0a2-c545-48df-bae5-370a263aed78 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.057631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.058365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.058710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.059062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.059869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] RBAC: Adding query filter params (role.id=28a53ad4f7ea45ceb52f1323d97b953d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=568b6aa97ee74544a6a87ad063938d43) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:24.060215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.061663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.068162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 455/912] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/role_assignments?user.id=568b6aa97ee74544a6a87ad063938d43&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=28a53ad4f7ea45ceb52f1323d97b953d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:24.077034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.102941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.104445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.104927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.105360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.106237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:24.106702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.108990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.120372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 458/913] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:24.122366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.139251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.224673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.234997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2caa07-28f9-442d-a77c-dff86cb3dd8a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.243246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3834-d0fd-4f37-bd85-1c9f37200358 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.281471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.282138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.282421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.282689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.282915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.283445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] RBAC: Adding query filter params (interface=public, service_id=d44797c5b8b44e72acbb4d62ea246ffa, region_id=RegionOne) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:24.283749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.284204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.284683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.285165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.285346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.286211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:24.286725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.288618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.296056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 456/915] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:24.298996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 459/915] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/endpoints?service_id=d44797c5b8b44e72acbb4d62ea246ffa&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:24.300020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.301329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.425061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426935b2-2440-4243-bcce-0084441d3e09 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.428679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.436238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be598-46c9-4301-8ecc-333f6eddf2f1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.464426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.465160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.465507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.465850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.466568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.468065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.480594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 457/916] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:59:24.484273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.485224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.485740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.486199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.487090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:24.487599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.489268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059931-51f7-435d-b15e-af31e5c1ad86 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.496346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 460/917] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:24.502904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.534248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93368b-3641-42f9-a9d9-3eb7e96a6a42 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.534594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93368b-3641-42f9-a9d9-3eb7e96a6a42 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.534813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93368b-3641-42f9-a9d9-3eb7e96a6a42 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.536643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 461/918] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:24.548381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.548836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.549696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.575750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:24.577502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:24.592796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:24.639512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc300877-7002-47a9-be51-cfb3d08c5185 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.668742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 462/919] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:24.681002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.682375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.682657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.682937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.683669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.685104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.699344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.769199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 458/920] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:24.823658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee7c49-2396-49d1-b4c4-5554a1b507ab None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:24.874333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:24.875445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:24.875963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:24.876436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:24.877282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:24.878894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:24.890043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:24.891156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:24.892074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:24.895106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 463/921] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:24.905056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:24.939210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:25.026468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe6f70-4aa1-494e-b15d-89abf772fefd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:25.063172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:25.064214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:25.064699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:25.065201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:25.066153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:25.066651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:25.068238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:25.074585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 459/922] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:25.080668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:25.084809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:25.191225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47672a-6e2e-45fe-8ef3-ca9571a1af63 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:25.230265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:25.231326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:25.231810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:25.232307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:25.233255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:25.233817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:25.235467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:25.242531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 464/923] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:25.249796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:25.364357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:25.369252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225aa08-a1e6-49c3-81ab-5e9566083992 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:25.404187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:25.404807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:25.405123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:25.405401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:25.406380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] RBAC: Adding query filter params (interface=public, service_id=9b810acd5a7b47139028e9d020650dd6, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:25.406743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:25.408242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec6fd0-e0f9-4e33-bc2d-d0ecabfeeed6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:25.414556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 460/924] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:25 2022] GET /identity/v3/endpoints?service_id=9b810acd5a7b47139028e9d020650dd6&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:25.420833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:25.491977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:25.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca618b3-1335-4c2a-9d6f-2bce41e448eb None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:25.565558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:25.566181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:25.566458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:25.566732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:25.567386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:25.568784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18d11-eab1-4224-9218-d0edd887ec41 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:25.576284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 465/925] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:25 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:59:26.169003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ada5a-c0b4-4b1c-9339-9c8ad31da93a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.169547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ada5a-c0b4-4b1c-9339-9c8ad31da93a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.169547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ada5a-c0b4-4b1c-9339-9c8ad31da93a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.171191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 461/926] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:26.176708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.177214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.177293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.197732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:26.198937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:26.271842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 466/927] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:26.295319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ada5a-c0b4-4b1c-9339-9c8ad31da93a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.409166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ada5a-c0b4-4b1c-9339-9c8ad31da93a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:26.444429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:26.444993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.445273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.445546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.458801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-4f2e39a3-7f80-4e01-b00f-281d49a0f6c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:26.464822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:26.465840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:26.466676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 462/928] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:26.472360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.539459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:26.581674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515828-56e4-4b08-bc2f-4f8b65d9c819 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:26.621437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:26.622094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.622375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.622648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.623384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:26.623687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:26.625145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:26.633935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314d47-9578-4273-8e5e-0e90df3268b1 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.635124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314d47-9578-4273-8e5e-0e90df3268b1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.635612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314d47-9578-4273-8e5e-0e90df3268b1 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.635975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 467/929] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:26.637498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 463/930] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:26.642485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.644330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d066f-db0f-465a-8268-b78794951c93 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.644687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d066f-db0f-465a-8268-b78794951c93 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.644963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d066f-db0f-465a-8268-b78794951c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.669172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-475d066f-db0f-465a-8268-b78794951c93 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:26.670392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-475d066f-db0f-465a-8268-b78794951c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:26.692306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:26.773095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 464/931] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:26.794542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a7349-ae20-47ca-91d8-f6d4fd39222c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:26.798835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d066f-db0f-465a-8268-b78794951c93 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.824377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:26.836322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:26.837868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.838346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.838782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.851430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:26.854225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:26.871497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:26.872504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:26.873402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:26.873402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:26.873402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:26.873402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:26.880216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 468/932] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:26.882074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.906252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d066f-db0f-465a-8268-b78794951c93 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:26.944928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:26.945807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.945807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.946091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.946858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:26.948312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-747dc595-cfd5-4c17-b21e-1c032fc50c76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:26.958730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:26.959728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:26.966435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 465/933] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:26.967296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12d72-0e45-4d94-a401-920a0b83446e None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:26.967296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12d72-0e45-4d94-a401-920a0b83446e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:26.967296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12d72-0e45-4d94-a401-920a0b83446e None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:26.967296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 466/934] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:26.967296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12d72-0e45-4d94-a401-920a0b83446e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:26.977773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.012302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b657e-d64b-4b6f-8f32-43e17f3868fc None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.046867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.047487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.047767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.048077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.048764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:27.049071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.050442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce370-848f-49aa-abf3-e0736951cbf1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.068076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 469/935] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:27.069371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.069657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.069934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.081331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12d72-0e45-4d94-a401-920a0b83446e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.090050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:27.091234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:27.119252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.119943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.120202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.120472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.121148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:27.121446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.122849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.124214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.132668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 467/936] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:27.132668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.164029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 470/937] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:27.165110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.227611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.262467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daffffa-d664-45fd-8807-dfe1944b2d73 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.277159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43dbd6-7249-4de9-a809-9bfaf400ee6d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.300282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.300920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.301200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.301468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.312369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.313875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.315680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.316343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.316627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.316905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.317593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:27.317906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.319274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.324586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 471/938] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:27.325392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:27.329089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:27.330214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:27.331539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:27.332660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 468/939] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:27.333541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.368222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.447391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718482-a50f-4a4d-994e-948f10318d12 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.450278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c1ec-817c-4c98-bbfd-ae89753b68af None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.475886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.483460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.484712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.484999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.485274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.485989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.487359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.488839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.489466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.489751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.490027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.490707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.492243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.495540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING keystone.server.flask.common [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 04:59:27.550622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.sql.core [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:59:27.550622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 04:59:27.550622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [parameters: {'id': 'd1335c0cf5b141c7badc4461426cda64', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 04:59:27.550622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:59:27.563538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 469/940] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1335c0cf5b141c7badc4461426cda64.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1335c0cf5b141c7badc4461426cda64. Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:59:27.568383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 04:59:27.569207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application yield resource Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise self.value Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application session.commit() Aug 04 04:59:27.570187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:59:27.571120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:59:27.572886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:59:27.573696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [parameters: {'id': 'd1335c0cf5b141c7badc4461426cda64', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.574578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:27.577408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d1335c0cf5b141c7badc4461426cda64. Aug 04 04:59:27.580825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.582153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.582303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 472/941] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Aug 4 04:59:27 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:27.582303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.701417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.718585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb943c-6fea-4530-9da7-5e44fd6f0266 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.731760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c56a59-1a84-4c4d-a57c-df0c43aa7fb0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.761533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.762115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.762395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.762665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.769853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.771512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.775593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.776531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.776531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.776779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.777590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:27.778554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.779825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca705e-300b-4b60-97c7-251dcdc477c2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-5fde1362-cf77-4925-a275-863906b3502e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:27.786118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:27.787065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:27.788009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 473/942] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:27.789071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f690d2-7fe2-45b6-99a6-1f238b737bd9 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.789363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f690d2-7fe2-45b6-99a6-1f238b737bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.789569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f690d2-7fe2-45b6-99a6-1f238b737bd9 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.795124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 474/943] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:27.795765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f690d2-7fe2-45b6-99a6-1f238b737bd9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.802227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 470/944] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:27.805453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.807303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.807790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.827716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:27.828980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:27.871728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.908427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 471/945] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:27.909291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:27.931892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f690d2-7fe2-45b6-99a6-1f238b737bd9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:27.977501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:27.978487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:27.978780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:27.979067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:27.979799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:27.980509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:27.981590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.007943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 475/946] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:28.007943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.012916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.047053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c6675-1c11-482b-b890-2fee81aa9e6c None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.091330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.092202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.092586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.093021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.105761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.107257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:28.126074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:28.127114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:28.128179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:28.128179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:28.128179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:28.128179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:28.128179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 472/947] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:28.129810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b13f36-7e45-4ee8-aa87-5cc90ae77d44 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.133286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.164211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.170767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.171436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.171717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.172028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.172673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.174140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:28.188927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:28.190374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:28.191463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:28.193408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 476/948] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:28.195247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.282894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.287555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b55808-9ea4-403e-80fb-9fdac175d3d1 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.328460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36a5d7-d30f-4a03-ba84-64e65b494f58 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.333597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.334226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.334503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.334777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.335474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:28.335777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.337817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.361457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 473/949] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:28.362720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.382028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.382664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.382952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.386480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.386480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:28.386480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.387039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.394311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 477/950] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:28.400903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.484126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.504759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b5aa-ab2f-47d3-84e4-5fb5f50e4a8c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.529595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4a786-99af-4db7-a67d-072e33fdc10c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.545725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.546298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.546579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.546854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.554657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.557082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.573955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.574992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.575503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.576016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.576922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:28.577445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.579129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:28.579922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:28.580850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:28.581753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:28.588697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 474/951] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:28.589902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.590319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 478/952] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:28.598557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.606717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.728901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9e26-f657-4533-b21b-a6277e2bd288 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.767799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.768708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.769179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.769676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.770549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.772371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.778224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d76d-b896-4e4d-a51f-f60c006766d6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:28.841981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:28.842880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:28.843365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:28.843858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:28.845364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:28.845928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:28.848668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e3f7c-ec9b-4653-a5e5-cda8e3120ae1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:28.861709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 479/953] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:28.876683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 475/954] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:28.884161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:28.951800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:29.019814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012031a6-463b-4c6a-9614-5941f1349e00 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:29.061508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:29.062316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:29.062598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:29.062878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/568b6aa97ee74544a6a87ad063938d43/roles/28a53ad4f7ea45ceb52f1323d97b953d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:29.065394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=568b6aa97ee74544a6a87ad063938d43, role_id=28a53ad4f7ea45ceb52f1323d97b953d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:29.066885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842c8d6-311d-4cd8-9f1f-94348f7c4c58 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:29.129166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 480/955] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:28 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/568b6aa97ee74544a6a87ad063938d43/roles/28a53ad4f7ea45ceb52f1323d97b953d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:59:29.934229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58d57-4269-4586-a6dd-3094babd3321 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:29.934753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58d57-4269-4586-a6dd-3094babd3321 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:29.934753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da58d57-4269-4586-a6dd-3094babd3321 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:29.936422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 476/956] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:29.942465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:29.942983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:29.943075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:29.963458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:29.964671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:30.038310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 481/957] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:30.060483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58d57-4269-4586-a6dd-3094babd3321 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:30.063434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:30.171333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da58d57-4269-4586-a6dd-3094babd3321 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:30.208852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:30.209499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.209780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.210056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.210758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:30.212277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-bf55d30b-2886-41bd-8264-65eff9d8d943 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:30.222667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:30.223701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:30.224600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 477/958] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:30.231029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:30.281623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79456-748c-4865-be15-30504e6b7a20 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.281981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79456-748c-4865-be15-30504e6b7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.282174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f79456-748c-4865-be15-30504e6b7a20 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.283652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 478/959] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:30.285265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:30.290977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.290977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.291805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.310241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:30.311504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:30.355182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bc303-b5cb-4edf-b5c6-470f19ac1f21 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:30.392505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:30.395562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:30.396226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.396503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.396771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.397448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:30.397746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:30.399162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:30.404196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 479/960] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:30.415965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 482/961] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:30.423113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:30.435337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:30.554738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b96f-4082-415b-8523-f30c4b33b5de None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:30.563045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b61db9-08ee-48de-a92f-90c2193b20e9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:30.565871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:30.602357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:30.603755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.604362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.604814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.604966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:30.605707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.606067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.606173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:30.606437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.606832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:30.607263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:30.608642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:30.608818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:30.619956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 480/962] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:30.657843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.sql.core [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:59:30.657843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 04:59:30.657843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [parameters: {'user_id': '919abdff7e2144f69262597a1245cbcb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 04:59:30.657843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:59:30.666066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:59:30.667178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application yield resource Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise self.value Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application session.commit() Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:59:30.668462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:59:30.669348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:59:30.670241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application result.read() Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:59:30.671100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [parameters: {'user_id': '919abdff7e2144f69262597a1245cbcb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:30.672102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 04:59:30.673017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:30.674017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 483/963] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Aug 4 04:59:30 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:30.676170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:30.764232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:30.814273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7237fc-d21f-472f-92e6-a4608e2bd4d7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:30.857674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:30.858330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:30.858612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:30.858886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:30.866925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:30.868791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-5d11fb8b-3cca-44f0-8f28-61ec28dfcc56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:30.881612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:30.882644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:30.883613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 481/964] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:30.890010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.003351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf553-1ea6-4558-b368-d1a23719a37e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.043386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.044061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.044346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.044621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.045575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:31.045888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.047581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.057985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26c70-daba-4945-923a-4f3dd53194d8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.058533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26c70-daba-4945-923a-4f3dd53194d8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.058613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f26c70-daba-4945-923a-4f3dd53194d8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.064602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 482/965] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:31.065986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29e91-29a3-457d-833f-cc3349fe243f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.066269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29e91-29a3-457d-833f-cc3349fe243f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.066544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29e91-29a3-457d-833f-cc3349fe243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.085751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-68b29e91-29a3-457d-833f-cc3349fe243f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:31.086970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-68b29e91-29a3-457d-833f-cc3349fe243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:31.091039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 484/966] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Aug 4 04:59:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:31.171200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 483/967] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:31.194739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.225048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:31.311651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168268-c70d-45e8-a0a4-b3109666382a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.315665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52415-04ba-4dfc-8caa-441d8c016e16 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.315888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52415-04ba-4dfc-8caa-441d8c016e16 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.316297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52415-04ba-4dfc-8caa-441d8c016e16 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.317652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 484/968] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:31.324008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.324288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.329819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.348665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:31.349727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:31.367706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.367706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.368245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.368245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.369303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.370786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:31.385959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:31.387019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:31.388175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:31.389642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 485/969] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:31.396178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.429267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:31.451515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 485/970] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:31.474751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.512714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:31.529454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed28a-3318-4f54-97c0-7a34f1b521d3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.566872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.567821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.568321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.568794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.569656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:31.570125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.572040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.577803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 486/971] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:31.586241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.606809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695be6b-db5c-461f-89af-b6e9feb535d1 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.651565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.652354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.652670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.652943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.665055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:31.670632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:31.671634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:31.672537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 486/972] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:31.678104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.718462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4576-ae1c-4e9c-bc3a-c2a6b6b08613 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.737906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:31.757016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.757437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.758541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.758541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.758807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:31.759781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.760960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.767689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 487/973] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:31.773170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.796059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:31.817946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46a2a0-acd1-4281-8d1e-3bcd8689e434 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.859294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.859972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.860423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.860589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.861261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:31.861570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.863016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.877945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 487/974] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:31.879227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:31.909020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d54d75-e4b9-42ec-b0cb-0087f72bc6a3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:31.948559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:31.949669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:31.949957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:31.950231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:31.951416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] RBAC: Adding query filter params (interface=admin, service_id=9b810acd5a7b47139028e9d020650dd6, region_id=RegionOne) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:31.951733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:31.953967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:31.964087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 488/975] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/endpoints?service_id=9b810acd5a7b47139028e9d020650dd6&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:31.968051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.006310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9e4d6-4612-4ca5-9c7a-440f7598b009 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.008063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.042489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.044022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.044302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.044733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.057845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.058450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.059966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:32.075457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:32.076607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:32.077591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:32.077591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:32.077591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:32.077591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:32.077591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 488/976] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:32.081862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8ef0b-996a-4dec-9340-84adbd68dfb5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.082215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.118188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.119340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.119650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.120021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.120676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.122050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.139938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 489/977] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:31 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:59:32.200016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70724b-dccc-489b-951e-c3ecca4e8288 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.237999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.238631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.238912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.239188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.239918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:32.240222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.241619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.256903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 489/978] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:32.262817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.380593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350a2f2-d94e-4b30-b22d-4294a7416751 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.418781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.419423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.419702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.419997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.428148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.429602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:32.442786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:32.443825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:32.445508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 490/979] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 04:59:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:32.453580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.469714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.558897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab428-7e18-4bc5-8b4d-215861cfc51c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.594135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.594761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.595041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.595314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.596138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:32.596448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.597883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b582-891e-4dcc-8705-2b0a8070b731 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.616677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 490/980] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Aug 4 04:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:32.622343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.626280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.735314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e5f1-9fba-4123-a7b0-48f42e4fe657 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:32.768956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:32.769586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.769869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.770142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.798866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b3f6-334e-4757-986f-2556047059ce None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.799321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b3f6-334e-4757-986f-2556047059ce None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.799661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b3f6-334e-4757-986f-2556047059ce None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.801278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 491/981] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:32.806715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971041-9153-4930-9874-39185e866ed2 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:32.807147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971041-9153-4930-9874-39185e866ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:32.807432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971041-9153-4930-9874-39185e866ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:32.828716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-91971041-9153-4930-9874-39185e866ed2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:32.829951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-91971041-9153-4930-9874-39185e866ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:32.850248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:32.851714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:32.856078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.902288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 492/982] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:32.925877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971041-9153-4930-9874-39185e866ed2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:32.928064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:32.980257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 491/983] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:32.986328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:33.032174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971041-9153-4930-9874-39185e866ed2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.071096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.071858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.072314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.072660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.073370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.074749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.096772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b7cdc-d313-4703-8db4-5d695fc0a57d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.099147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:33.131844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.132677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.132982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.133245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.143834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.145318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.156634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 493/984] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:32 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:33.160990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:33.161939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:33.176294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:33.176294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:33.176294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:33.176294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:33.176294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 492/985] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:33.176608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:33.240530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:33.294389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b7a7-a422-4a9f-be54-18782e9dd90d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.335159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.336242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.336515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.336787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.338063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:33.338340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.339711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.353830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 494/986] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:33.359052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:33.466257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cdf3a-00db-43eb-9781-0deb528f62ea None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.500231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.500789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.501069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.501340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.508281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.510660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:33.522382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:33.523328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:33.524275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 493/987] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:33.530563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:33.635038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a54f2-a5dc-46b5-bdf0-b9153153ee00 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.653777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:33.671631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.672283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.672562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.672833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.673603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:33.673906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.675320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1ef22-18a0-4ef3-a32c-dcc760991a6a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.690541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 495/988] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:33.693205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:33.717327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:33.802550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05ea76-e8ca-4a2a-a0d5-9b16ea772959 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:33.838549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:33.839174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:33.839455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:33.839730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:33.840560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] RBAC: Adding query filter params (role.id=28a53ad4f7ea45ceb52f1323d97b953d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=568b6aa97ee74544a6a87ad063938d43) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:33.840871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:33.842330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0e74b-ab31-4442-9f3c-6cbf00dd0b76 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:33.848858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 494/989] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:33 2022] GET /identity/v3/role_assignments?user.id=568b6aa97ee74544a6a87ad063938d43&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=28a53ad4f7ea45ceb52f1323d97b953d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:34.225512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cddb5d-cc41-4ddd-8db9-dc614431715f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.226037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cddb5d-cc41-4ddd-8db9-dc614431715f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.226116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cddb5d-cc41-4ddd-8db9-dc614431715f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.227556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 496/990] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:34.233006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.233452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.233652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.252396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:34.253918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:34.325124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 495/991] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:34.347935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cddb5d-cc41-4ddd-8db9-dc614431715f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:34.472791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cddb5d-cc41-4ddd-8db9-dc614431715f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:34.505879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:34.506438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.506714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.506982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.507609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:34.509628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:34.518665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:34.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:59:34.520671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:34.524224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 497/992] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Aug 4 04:59:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:34.525945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:34.537755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:34.629046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf9d7-c88a-4581-bb28-0de7d9e35cef None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:34.663352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:34.664321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.664756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.665740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.666702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:34.667156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:34.668962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:34.674372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 496/993] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:34.679703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:34.725301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:34.783011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbe227-f206-4632-9d3c-eb91e7bd67dc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:34.820199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:34.820817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.821092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.821392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.822232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:34.822470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:34.823823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bde92-cdf5-4525-9706-d3e4cd928707 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:34.833373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 498/994] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Aug 4 04:59:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:34.834393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:34.912536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:34.938345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88aa7-4652-41fd-81f9-4fe898253d24 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:34.973967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:34.974593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:34.974874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:34.975148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:34.975856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:34.977295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee041fec-fdab-4288-8980-912aa18f8fd6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:35.047929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 497/995] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:35.268510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4e11-13aa-4993-846c-08008b922d69 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.269082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4e11-13aa-4993-846c-08008b922d69 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.269082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4e11-13aa-4993-846c-08008b922d69 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.270645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 499/996] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:35.276439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.276917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.277000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.295583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:35.296808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:35.375955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 498/997] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:35.399001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4e11-13aa-4993-846c-08008b922d69 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:35.507009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4e11-13aa-4993-846c-08008b922d69 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:35.515515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:35.543387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:35.544061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.544346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.544621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.545253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:35.546641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:35.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:35.557823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:35.564144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 500/998] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:35.566645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:35.627954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:35.670500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca46d-44c4-4d28-b73d-949eea3c129f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:35.715108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:35.715738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.716056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.716335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.717022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:35.717329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:35.718701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:35.728485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 499/999] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:35.730069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:35.837622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51553165-de0e-4447-aa95-573ef9682da7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:35.872170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:35.872788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.873069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.873399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.874084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:35.874389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:35.875780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3b905-d424-4a10-b114-b3f13cbc2fd8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:35.885698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 501/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:35.887212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:35.932752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abd07-0905-47b4-aefe-6f5ed0086b94 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.933072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abd07-0905-47b4-aefe-6f5ed0086b94 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.933354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abd07-0905-47b4-aefe-6f5ed0086b94 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.934700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 502/1001] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:35.940662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:35.940951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:35.941233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:35.959373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:35.960597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:35.988291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:35.995315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8589a-7dfb-4550-9762-19f288cbf02c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:36.020773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:36.031941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 503/1002] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:36.033996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:36.034659 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:36.034946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:36.035216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:36.035992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] RBAC: Adding query filter params (interface=public, service_id=54d5f2188d894b52b02150dda1383c8d, region_id=RegionOne) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:36.036305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:36.037701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:36.047569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 500/1003] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:35 2022] GET /identity/v3/endpoints?service_id=54d5f2188d894b52b02150dda1383c8d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:36.049133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:36.053777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:36.157722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a100-890d-4a82-b635-99b7f8260428 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:36.162913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c4325-5230-4525-acc3-29b96e794407 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:36.197360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:36.197988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:36.198284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:36.198556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:36.199221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:36.200663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:36.201027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:36.201879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:36.202162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:36.202443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] PATH_INFO: `/v3/services/image` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:36.203092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:36.204561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:36.208182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 504/1004] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:36 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:36.215269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:36.216610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:36.217743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:36.220389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 501/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 04:59:36 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:36.222684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:36.255224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:36.335551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc1828-288e-4111-9bf4-40618c4f31d0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:36.373270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:36.373880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:36.374168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:36.374440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:36.375114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:36.375425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:36.376825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49743ea-99a5-4f1d-ac68-c91ac4feedf0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:36.381889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 505/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:36.387485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:36.447980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:36.496903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd788a-f68f-4067-9edf-b10cc98665bf None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:36.530803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:36.531425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:36.531707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:36.532009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:36.532693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:36.533238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:36.534372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656375f8-e230-4a26-acb6-26d27e4a6b89 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:36.539356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 502/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:37.124138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06571-be05-48ad-b442-1a888e6fbb5b None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:37.124486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06571-be05-48ad-b442-1a888e6fbb5b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:37.124696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06571-be05-48ad-b442-1a888e6fbb5b None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:37.126169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 506/1008] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:37.131131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:37.131419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:37.131690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:37.150367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:37.151552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:37.222407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 503/1009] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:37.246055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f06571-be05-48ad-b442-1a888e6fbb5b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:37.341885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:37.351573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f06571-be05-48ad-b442-1a888e6fbb5b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:37.389087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:37.389643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:37.389921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:37.390192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:37.391337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:37.392790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186522-6fc5-4cb1-8143-6e27dfa18fca None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:37.394523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 507/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:37.400497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:37.447998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:37.514335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6aa13-2118-4e52-9f6a-21b27d76ec4c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:37.550118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:37.550738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:37.551021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:37.551365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:37.552018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:37.553486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15a9b1-2d9e-4724-ad55-e96b0284adcb None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:37.661432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 504/1011] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:37 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:38.299553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d901-ae0d-4159-8b09-135b84bb98c1 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.299861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d901-ae0d-4159-8b09-135b84bb98c1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.300154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7d901-ae0d-4159-8b09-135b84bb98c1 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.301623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 508/1012] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:38.306652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0f49-d2d6-4c30-9bbc-0a8860b1dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.306941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0f49-d2d6-4c30-9bbc-0a8860b1dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.307220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0f49-d2d6-4c30-9bbc-0a8860b1dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.326059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-93bd0f49-d2d6-4c30-9bbc-0a8860b1dfe3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:38.327252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-93bd0f49-d2d6-4c30-9bbc-0a8860b1dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:38.394301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 505/1013] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:38.417413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7d901-ae0d-4159-8b09-135b84bb98c1 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:38.528067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7d901-ae0d-4159-8b09-135b84bb98c1 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:38.564254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:38.564812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.565094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.565371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.565998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:38.567371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:38.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:38.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:38.584260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 509/1014] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:38.585095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4487-b186-42a3-9ace-595a2784186f None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.585095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4487-b186-42a3-9ace-595a2784186f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.585095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed4487-b186-42a3-9ace-595a2784186f None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.585095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 506/1015] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:38.585677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:38.588375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.588661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.588937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.607688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:38.608930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:38.611895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:38.635456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:38.684494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 507/1016] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:38.702307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664e1d-e96e-47aa-bd3a-8fa0713a6e3a None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:38.707068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:38.750186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:38.750831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.751113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.751389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.752110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:38.752414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:38.753777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:38.758824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 510/1017] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:38.764285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:38.834882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e387ce-74b0-424b-ba0d-be16da2648c1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:38.862172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:38.874207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:38.874833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.875323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.875442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.876101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:38.877477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a51e6-5a27-44e5-8d3a-3f2f25a43724 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:38.878046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b89cf5-dbfe-4b34-86e0-7abe954dc8b2 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:38.913635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:38.914248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:38.914527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:38.914798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:38.916196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:38.916500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:38.918112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:38.922890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 511/1018] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Aug 4 04:59:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:38.928652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:38.951702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 508/1019] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 04:59:38 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:39.049149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f0ea-4220-4f5c-93c8-fc06d80b1b19 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:39.093289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:39.094160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:39.094592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:39.095015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:39.095883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:39.097481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e91c-780b-4fb8-b8b7-0a851aa9d298 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:39.163403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 512/1020] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:39.743209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601560f2-6172-4120-8b2d-e0038620f109 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:39.744458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601560f2-6172-4120-8b2d-e0038620f109 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:39.744458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601560f2-6172-4120-8b2d-e0038620f109 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:39.745866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 509/1021] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:39.751289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:39.751720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:39.751894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:39.759859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:39.771345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:39.772783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:39.851091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 513/1022] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:39.875638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601560f2-6172-4120-8b2d-e0038620f109 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:39.896596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:39.986110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601560f2-6172-4120-8b2d-e0038620f109 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:40.021547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:40.022252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:40.022541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:40.022819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:40.024043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:40.026090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33bfbe-770c-46c7-b66b-0521a2022aa7 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:40.032255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 510/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:40.033671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:40.139875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55cc0c-25cd-4068-9d6b-5c100fab7a74 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:40.168649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:40.174976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:40.175668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:40.175974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:40.176253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:40.176954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:40.180571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34411af-9e61-4026-a30e-e86f708384bf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:40.264027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 514/1024] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:59:40 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:41.021934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ea41-fdc5-4c84-91f4-030391a0d548 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.022433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ea41-fdc5-4c84-91f4-030391a0d548 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.022433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647ea41-fdc5-4c84-91f4-030391a0d548 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.023750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 511/1025] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:41.030111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.030544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.030722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.049699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:41.050885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:41.123997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 515/1026] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:41.144906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ea41-fdc5-4c84-91f4-030391a0d548 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.239636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.257604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647ea41-fdc5-4c84-91f4-030391a0d548 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.294285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.294873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.295149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.295422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.296078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.297447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-234ff44b-1662-437f-8ad2-24df78d53cb2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:41.307662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:41.308782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:41.309650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 512/1027] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:41.316529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.329758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0525-4f0f-4fae-b47c-7e4a2ba34d77 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.330022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0525-4f0f-4fae-b47c-7e4a2ba34d77 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.330305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0525-4f0f-4fae-b47c-7e4a2ba34d77 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.331690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 513/1028] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:41.337126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.337543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.337823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.357670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:41.358869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:41.430213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e485-2a7a-43d5-a1f7-7a295b1e1881 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.448387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.461247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 514/1029] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:41.473342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e274a-e535-4638-be22-35aa300982de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.473958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e274a-e535-4638-be22-35aa300982de None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.474235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e274a-e535-4638-be22-35aa300982de None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.474505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e274a-e535-4638-be22-35aa300982de None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.475214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e274a-e535-4638-be22-35aa300982de None admin] RBAC: Adding query filter params (name=image) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:41.475536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e274a-e535-4638-be22-35aa300982de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.476926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e274a-e535-4638-be22-35aa300982de None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:41.487535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 516/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:41.487739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.488609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e274a-e535-4638-be22-35aa300982de None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.575832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.596332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b1e32-d82e-46f1-9b7b-2ea1181c1f7e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.604209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e274a-e535-4638-be22-35aa300982de None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.636147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.636864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.637398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.637576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.641977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.642599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.642882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.643169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.643838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] RBAC: Adding query filter params (type=image) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:41.644196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.645581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:41.649216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:41.650789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 517/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:41.654452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:41.655379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:41.656634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:41.657290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.657819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 515/1032] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:41.662205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.713752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.773190 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57119b-f12a-4e0d-bfcc-836fbf803508 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.780787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5525-9f43-44a6-ad95-dea61224436e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.812030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.812659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.812949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.813222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.813993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] RBAC: Adding query filter params (interface=public, service_id=191990c5a8a34772a1bb0bff31c59171, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:41.814303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.815681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:41.818380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.819007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.819286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.819556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.820299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:41.820600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.822041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:41.826811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 518/1033] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/endpoints?service_id=191990c5a8a34772a1bb0bff31c59171&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:41.827507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.831987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 516/1034] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:41.837960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:41.841714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.940012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148b8b-e808-495c-a954-ebce41fb9d3e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.949268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.960278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752edc8-466e-4ba8-977b-1ce2f0aba5d3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:41.980476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:41.981460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:41.982091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:41.982549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:41.983889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:41.985950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.001768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 519/1035] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:59:42.002023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.002023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.002023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.002023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.012622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.014145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:42.030240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:42.032011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:42.033187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:42.033187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:42.033187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:42.033187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:42.033187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 517/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:42.037356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.149070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68813c-4542-497f-accc-086e79003d23 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.187412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.188061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.188342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.188612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.189303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:42.189603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.190969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21707756-b605-4202-baa6-c3acd45107b8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.204593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 520/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:42.210656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.271227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.320183 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a47-57b8-4892-96a5-b162430834c8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.357171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.357814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.358092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.358361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.367040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.368861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:42.380571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:42.381596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:42.387748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 518/1038] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:42.389958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b572-b936-42f0-8404-5c3152ce8e2c None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.390244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b572-b936-42f0-8404-5c3152ce8e2c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.390350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.390511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b572-b936-42f0-8404-5c3152ce8e2c None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.392156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 521/1039] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:42.397603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.397988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.398371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.422728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:42.423841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:42.452499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.496081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 522/1040] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:42.512015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca21054-d221-40b1-96a9-3c129932dd3e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.523288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.528936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.552858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.553889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.554314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.554741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.556096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:42.557133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.558683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.584235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 519/1041] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:42.585303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.637280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c47c5-2ab2-44be-8193-5fdfeb52a156 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.682247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.682817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.683104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.683399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.694040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:42.694420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251764-8568-4bfe-b6b0-b9b20976aa6a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:42.699741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:42.700875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:42.704963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 523/1042] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:42.707383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.732889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.744661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.744914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.746112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.746112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.795010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.815030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc266bb-78d3-4a48-8d03-f08526bc4071 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:42.821916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.823632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.855075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:42.856024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:42.856463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:42.856740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:42.857456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:42.857762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:42.859135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:42.872445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 524/1043] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:42.873588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.939020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 520/1044] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:42.944403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:42.965563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:42.981320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fb03c-929d-4fbd-9430-9b9f92f7b19f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.018121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.018791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.019073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.019343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] PATH_INFO: `/v3/users/67125da584204ebabe2dca6a72d15cd4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.032577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.035702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] RBAC: Authorizing `identity:get_user(user_id=67125da584204ebabe2dca6a72d15cd4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.037191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.038889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 525/1045] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/users/67125da584204ebabe2dca6a72d15cd4 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:43.045517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.067596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed31ad-58fe-41e9-ade3-f0d3446eee89 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.104817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.105467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.105746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.106016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.116565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.118560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:43.135251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:43.136294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:43.137191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:43.137191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:43.137191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:43.137191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:43.137191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 521/1046] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:43.142376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.166598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbfdbc-3baa-4e02-ba60-09cbfa313333 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.205564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.206107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.206387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.206659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.220757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.263644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ee1-3f6f-4095-a7c4-deeb87a27b24 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.280109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.281570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.289698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.301881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.302499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.302774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.303043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.303728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:43.304060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.305426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.324128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 522/1047] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:43.324878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.394332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 526/1048] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:59:43.395421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.440634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752192fb-eda4-4077-8b96-bd31bc2acf04 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.441164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.480579 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.481431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.481712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.481990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.490643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.492599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.502101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37334f8-4d5a-4fab-9812-3d130c44c4a8 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:43.508453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:43.510256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:43.511258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:43.517250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 523/1049] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:43.518099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.541581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.542616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.543222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.543562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.544863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.546304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.552885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 527/1050] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:43.554105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.568867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.638724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22c43-1c3e-49b9-b4f5-1a3e16e86a1b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.665498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ca4a8-e615-4d2e-932e-95ef2a51ca82 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.675057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.675679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.676188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.676299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.676996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:43.677493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.677969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.678736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.692315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 524/1051] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:43.698930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:43.709721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.710345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.710624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.710895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.711693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23, user.id=67125da584204ebabe2dca6a72d15cd4) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:43.712038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.714785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6414-bf86-4aab-893e-db6d4121353b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.721844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 528/1052] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/role_assignments?user.id=67125da584204ebabe2dca6a72d15cd4&scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:43.835854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd1c7-892e-4d9d-95c5-2bd4173bba39 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:43.839152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:43.880043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:43.881041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:43.881473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:43.881897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:43.882855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] RBAC: Adding query filter params (role.id=28a53ad4f7ea45ceb52f1323d97b953d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:43.883338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:43.886031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26d96f-3e78-484c-aa4e-0dce39b32e95 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:43.893556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 525/1053] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:43 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=28a53ad4f7ea45ceb52f1323d97b953d => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:44.093502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bbe7-2abd-4120-9237-a99f887b901c None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.094001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bbe7-2abd-4120-9237-a99f887b901c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.094001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bbe7-2abd-4120-9237-a99f887b901c None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.095465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 529/1054] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:44.100670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.101086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.101258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.119810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:44.121031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:44.195935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 526/1055] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:44.219786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bbe7-2abd-4120-9237-a99f887b901c None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:44.325017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bbe7-2abd-4120-9237-a99f887b901c None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:44.362166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:44.362825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.363103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.363422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.364090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:44.365516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:44.375195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:44.376352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:59:44.377219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:44.381701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 530/1056] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Aug 4 04:59:44 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:44.383067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:44.485290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:44.489532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b061-d660-4c35-82a8-65a82503bc73 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:44.525139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:44.525769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.525965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.526189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.526841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] RBAC: Adding query filter params (name=image) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:44.527143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:44.528551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:44.538210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 527/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:44.539525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:44.585871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:44.648996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8dd7-589a-454d-8aed-4ce9a38de2f0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:44.685776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:44.686385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.686661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.686929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.687594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:44.687953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:44.689327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3737d-0047-4897-be36-38eed37928e2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:44.694407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 531/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:44.701181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:44.805386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b157b-f8b3-4ef0-95bf-534362a4706b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:44.840364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:44.840983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:44.841260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:44.841527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:44.842247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:44.843612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf126a0-e49a-4ab4-92af-476b0eaa4d74 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:44.942281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 528/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 04:59:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:59:45.794520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492d2-89de-4cad-ab96-90067cec669b None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:45.795038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492d2-89de-4cad-ab96-90067cec669b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:45.795116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9492d2-89de-4cad-ab96-90067cec669b None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:45.796633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 532/1060] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:45.801863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6007b-a72d-4ff9-a8d0-545e43c699be None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:45.802252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6007b-a72d-4ff9-a8d0-545e43c699be None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:45.802427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6007b-a72d-4ff9-a8d0-545e43c699be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:45.820363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f5e6007b-a72d-4ff9-a8d0-545e43c699be None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:45.822163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f5e6007b-a72d-4ff9-a8d0-545e43c699be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:45.836556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:45.899789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 529/1061] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:45.922682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9492d2-89de-4cad-ab96-90067cec669b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:45.936406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c965a8-1a2b-4682-98e0-ba34bc01d965 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:45.936693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c965a8-1a2b-4682-98e0-ba34bc01d965 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:45.936972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c965a8-1a2b-4682-98e0-ba34bc01d965 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:45.938466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 530/1062] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:45.943060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:45.943353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:45.943636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:45.962982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:45.964130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:46.035801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 531/1063] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:46.040639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9492d2-89de-4cad-ab96-90067cec669b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.042307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.060048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.078130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.078789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.079070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.079345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.092787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:46.097818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:46.098793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:46.099672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 533/1064] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:46.105862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.149851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.176596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d603e31-ed8d-4a55-ba6f-2520a819793d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.213105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.213668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.213950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.214224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.222974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2b3ce-a352-4776-b0d8-c91df1845931 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.224373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:46.230134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:46.231283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:46.232150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 532/1065] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:46.237910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.266110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.266741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.267011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.267282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.268136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:46.268536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.269980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.284740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 534/1066] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:46.285743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.312708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.351076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5976f0-64f4-4f40-9c95-0b388dbc1b87 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.389989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.390603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.390874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.391184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.391845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:46.392178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.393544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.395281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.399374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc387d6-f1ec-49fe-8eec-ab42a1a56595 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.404292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 533/1067] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:46.410137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.437293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.437928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.438202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.438471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] PATH_INFO: `/v3/users/67125da584204ebabe2dca6a72d15cd4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.439769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] RBAC: Authorizing `identity:get_user(user_id=67125da584204ebabe2dca6a72d15cd4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.441410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.443343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 535/1068] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/users/67125da584204ebabe2dca6a72d15cd4 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:46.449548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.529597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07076e02-6401-4c1e-bdc6-2f7945799914 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.550617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.561835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719286d-fc45-4fc5-a2ea-9e8d7e2fd219 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.568465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.569120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.569540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.569825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.581711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.583448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:46.599172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:46.600198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:46.601089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:46.601089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:46.601089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:46.601089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:46.601089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 534/1069] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:46.603590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.604266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.604547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.604903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.606095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.606197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.607608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.614249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 536/1070] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:46.615215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.672952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.727377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a03afb-09c5-4231-ac69-0719726b8e2b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.728136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825c91-0790-43ba-aa18-77ea87689208 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.764660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.765323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.765603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.765880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23/users/67125da584204ebabe2dca6a72d15cd4/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.767322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.767819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] RBAC: Authorizing `identity:create_grant(project_id=0ccfe4cc98e84b0b9077eeca10acaf23, user_id=67125da584204ebabe2dca6a72d15cd4, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.768022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.768228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.768499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.769195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:46.769356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.769525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.770837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.784813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 535/1071] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:46.789708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.838809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 537/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:46 2022] PUT /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23/users/67125da584204ebabe2dca6a72d15cd4/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:59:46.898569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f79bca-951d-40bd-83bf-93f49172b409 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:46.909918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:46.937922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:46.938581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.938862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.939137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.949394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:46.950915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-0d1841e1-c4d3-4086-908b-c53bfc185191 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:46.964030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:46.965142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:46.966108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 536/1073] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:46.974063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:46.989904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d52a-3580-4536-b136-fc5290db840c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.990263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d52a-3580-4536-b136-fc5290db840c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:46.990531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d52a-3580-4536-b136-fc5290db840c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:46.992532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 537/1074] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:46.999664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:46.999975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.000259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.002051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.021635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:47.022873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:47.088227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5696c-7c5c-4941-81ce-af4508ba47bf None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.100247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 538/1075] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:47.121932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.126228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.126859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.127138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.127412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.128242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:47.128550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.129985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.154919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 538/1076] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:59:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:47.156364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.230750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.233926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea00e4-5f3a-4078-b7ac-7c5970148bb9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.239280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.261967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0681e33-05b7-4171-a75a-8207a372bc50 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.270473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.271181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.271474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.271749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.296961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.298168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.298843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.299596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.310247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.312222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:47.328275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:47.329428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:47.330640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:47.330640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:47.330640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:47.330640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:47.331506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 539/1077] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:47.337487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.349205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.350722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.448399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a878a-0e72-4dbf-9183-5b481dad0e96 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.451412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.458108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 539/1078] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:59:47.462496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.481229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.487392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.488085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.488317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.488665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.489348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:47.489658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.492354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.503178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 540/1079] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:47.509293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.570646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9cde0-3841-439b-91a3-5446addd9268 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.607237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.607788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.608101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.608377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.615265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4316-97cd-4b7a-8639-041c58782039 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.619361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.620839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:47.636017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:47.636926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:47.637832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:47.637832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:47.637832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:47.637832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:47.642375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 540/1080] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:47.643042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.655499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.656532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.656825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.657106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.664095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.666239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:47.677975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:47.678883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:47.679865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 541/1081] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:59:47.684818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.701043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.743557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:47.758563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e6cb-e34f-4a8d-932a-59681dfe3784 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.795735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8c42c-66dd-40e3-9c74-718aa1170769 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.796116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.796530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.796810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.797082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.797767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:47.798066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.799441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.812666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 541/1082] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:47.831790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:47.832457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:47.832734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:47.833006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:47.833843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:47.834141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:47.835678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807db6a-dbc6-4ec5-bcc2-834bedfec4e1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:47.849975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 542/1083] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:47.856515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:47.969903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56943f-90f4-4c47-9e4a-612fd06ae761 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:47.984254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:48.013020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:48.013701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:48.013983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:48.014261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/28a53ad4f7ea45ceb52f1323d97b953d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:48.016542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=55b281089b494473a7b58228ac75c898, role_id=28a53ad4f7ea45ceb52f1323d97b953d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:48.017999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1df5-f43d-4990-8e09-c778012ddee9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:48.100103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 542/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:47 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/55b281089b494473a7b58228ac75c898/roles/28a53ad4f7ea45ceb52f1323d97b953d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:59:48.886029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec0e2-c9d2-47fa-95d5-2a5bbbab5cc5 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:48.886583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec0e2-c9d2-47fa-95d5-2a5bbbab5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:48.886583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ec0e2-c9d2-47fa-95d5-2a5bbbab5cc5 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:48.887896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 543/1085] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:48.893003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:48.893284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:48.893550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:48.911500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:48.912689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:48.977805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 543/1086] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:49.000464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec0e2-c9d2-47fa-95d5-2a5bbbab5cc5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.107041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ec0e2-c9d2-47fa-95d5-2a5bbbab5cc5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:49.117687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:49.141708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:49.142345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:49.142630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:49.142904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:49.153151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:49.158095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:49.159119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:59:49.160030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:49.164069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 544/1087] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 04:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:49.165519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.266181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:49.269624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b3e80-7a2d-40ee-85dd-29ce24b8fa38 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:49.303785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:49.304435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:49.304714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:49.304987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:49.306242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:49.306582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:49.307942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:49.316299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 544/1088] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 04:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:49.322303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.423176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ad70d-9d42-45cb-9c6a-f118e2cc8c83 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:49.456932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:49.457555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:49.457835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:49.458108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] PATH_INFO: `/v3/users/67125da584204ebabe2dca6a72d15cd4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:49.459267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] RBAC: Authorizing `identity:get_user(user_id=67125da584204ebabe2dca6a72d15cd4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:49.460723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:49.463035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 545/1089] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:49 2022] GET /identity/v3/users/67125da584204ebabe2dca6a72d15cd4 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:49.468686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.568648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c76a58-1248-48c6-98c8-2c04a1f8ebd1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:49.604244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:49.604859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:49.605136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:49.605405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:49.637050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:49.675610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:49.677115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:49.781495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 545/1090] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:49.787518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.828124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:49.887075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e839b2-e7b0-43b0-91c5-0617d858c5db None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:49.920710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:49.921350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:49.921633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:49.921910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:49.923099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:49.924574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebef3f-1b56-4bec-ae7a-d1e5d9344797 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:49.926235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 546/1091] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:59:49 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:49.932879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:49.993389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:50.031246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe74d0f-3fec-4546-bd02-63b8f414312b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:50.065864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:50.066478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.066757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.067029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.067812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23, user.id=67125da584204ebabe2dca6a72d15cd4) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:50.068148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:50.069581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9dcdb-4887-4c2c-9ac0-76f06605b0f1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:50.076287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 546/1092] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:49 2022] GET /identity/v3/role_assignments?user.id=67125da584204ebabe2dca6a72d15cd4&scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:50.186987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c6d4-7fa3-4de9-8291-071e0fffb209 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.187265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c6d4-7fa3-4de9-8291-071e0fffb209 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.187540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0c6d4-7fa3-4de9-8291-071e0fffb209 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.188921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 547/1093] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:50.194587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.194873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.195151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.215070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:50.216340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:50.286929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 547/1094] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:50.310405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0c6d4-7fa3-4de9-8291-071e0fffb209 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:50.435810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0c6d4-7fa3-4de9-8291-071e0fffb209 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:50.443445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:50.470397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:50.471035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.471314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.471590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.482572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:59:50.487495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:50.488506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:59:50.489350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:50.492065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 548/1095] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Aug 4 04:59:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:50.494701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:50.556121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:50.605604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d308a2-266c-432f-ad54-88d77b942d09 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:50.641127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:50.641741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.642020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.642295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.643031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:50.643334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:50.644746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:50.652949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 548/1096] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 04:59:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:50.658584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:50.760538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d188-c3f4-473a-9300-2869aa8ae62d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:50.793718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:50.794349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.794626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.794895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.806398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:50.807837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:50.822984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:50.824178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:50.825161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:50.825161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:50.825161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:50.825161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:50.825161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 549/1097] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:50.829974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:50.929872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511b0e-53d6-442f-a145-d9e204a511b3 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:50.947257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:50.965321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:50.965321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:50.965321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:50.965321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:50.965814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:50.965902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:50.967238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:50.979590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 549/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:50.985199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:51.004880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:51.083589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7483e8f-0d69-4a60-8158-a998a0b0f009 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:51.116397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:51.117027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:51.117306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:51.117580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:51.125668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:51.127107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:59:51.138341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:51.139378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 04:59:51.140383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 550/1099] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Aug 4 04:59:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:51.145295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:51.244885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752608c-e088-41ac-bed9-a382f7e07f46 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:51.280849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:51.281475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:51.281758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:51.282034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:51.282842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:51.283150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:51.284639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:51.302346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 550/1100] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Aug 4 04:59:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:51.309340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:51.388287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:51.409314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb508-ecfd-4918-b5a3-6ac7a7505a73 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:51.443465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:51.444120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:51.444406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:51.444683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:51.511214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:51.512628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:51.588300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:51.610127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 551/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:51.615844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:51.652280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:51.720383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113065e-53c0-4f4e-8b7f-529816f8f493 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:51.755418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:51.756096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:51.756379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:51.756652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:51.767517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:51.768946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:59:51.783542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:51.784680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:51.785597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:59:51.785597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:59:51.785597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:59:51.785597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:51.785597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 551/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:51.791184 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:51.891430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a788-f855-466b-8023-5e6cb57e5c47 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:51.926247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:51.926852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:51.927130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:51.927399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:51.928101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:51.928402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:51.929756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:51.940979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 552/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 04:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:51.947223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:52.033691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:52.045608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f899e-3a7d-4dec-917d-2af33c43b312 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:52.079489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:52.080169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.080449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.080720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.087394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:52.089026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-eb231260-5e18-45cb-b268-802ba708bf44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:59:52.100129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:59:52.101063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 04:59:52.101988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 552/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 04:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:59:52.107226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:52.146884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:52.207434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff8e-dc93-4068-b3a4-cb7f2d638f86 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:52.228068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08cf1-a2fb-459e-a3d5-4f75b1aad7b8 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.228621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08cf1-a2fb-459e-a3d5-4f75b1aad7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.228621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08cf1-a2fb-459e-a3d5-4f75b1aad7b8 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.229974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 553/1105] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:59:52.235616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.235919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.236211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.244408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:52.245027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.245305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.245573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.246320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:52.246624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:52.248065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:52.254722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:52.255952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:52.261270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 553/1106] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 04:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:52.267276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:52.324737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 554/1107] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:59:52.349255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:52.364202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:52.368471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf673-5fbd-4816-a607-ebc212927c70 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:52.403515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:52.404157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.404442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.404718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.405514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] RBAC: Adding query filter params (role.id=28a53ad4f7ea45ceb52f1323d97b953d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=55b281089b494473a7b58228ac75c898) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:52.405828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:52.407275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:52.413403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 554/1108] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:52 2022] GET /identity/v3/role_assignments?user.id=55b281089b494473a7b58228ac75c898&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=28a53ad4f7ea45ceb52f1323d97b953d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:52.431438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:52.457490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436aeab-0ca7-4194-9ef5-15ad348eca01 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:52.497176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:52.497842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.498125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.498398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.499603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:52.501114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f31fa-89b3-452f-93d0-d38268a15a85 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:52.502802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 555/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 04:59:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:59:52.508949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:52.614272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25680-7b75-4e72-8023-65ab5b86e9e7 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:52.651715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:52.652388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:52.652669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:52.652948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:52.653646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:52.655112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000e42-e38d-49ff-afbc-7c3171b7f54d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:52.751228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 555/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 04:59:52 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:59:54.817372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb879e9-f3f0-4c46-b972-a33626af12e7 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:54.817891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb879e9-f3f0-4c46-b972-a33626af12e7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:54.817891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb879e9-f3f0-4c46-b972-a33626af12e7 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:54.819268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 556/1111] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:54.825089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:54.825492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:54.825649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:54.844193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:54.845398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:54.858583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:54.912504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 556/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:54.936685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb879e9-f3f0-4c46-b972-a33626af12e7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:55.038496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb879e9-f3f0-4c46-b972-a33626af12e7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:55.072978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:55.073618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:55.073901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:55.074179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] PATH_INFO: `/v3/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:55.075633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] RBAC: Authorizing `identity:get_role(role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:55.077039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:55.078394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 557/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:54 2022] GET /identity/v3/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:55.084421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:55.178840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d10a8-e41c-4b6f-880a-cc3584f1ed05 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:55.212538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:55.213165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:55.213441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:55.213711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] PATH_INFO: `/v3/users/9f679672201c40c7aa918017e414cc73` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:55.226478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] RBAC: Authorizing `identity:get_user(user_id=9f679672201c40c7aa918017e414cc73)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:55.228159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:55.229791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 557/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:55 2022] GET /identity/v3/users/9f679672201c40c7aa918017e414cc73 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:55.235760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:55.252141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.335376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142361a-1e99-4dd9-a519-0d9efa4b8469 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:55.369798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:55.370409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:55.370691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:55.370966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:55.436866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:55.438325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:55.452965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.536367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 558/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 04:59:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:59:55.542420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:55.551440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.641477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8afa-2a93-4e43-a752-fa2124997c63 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:55.682340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:55.682974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:55.683257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:55.683533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:55.684712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:55.686154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a988e0-71fe-47ae-928d-711916168865 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:55.687839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 558/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:59:55 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:55.693974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:55.792790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43067b-8429-4545-bc27-359a403a71ca None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:55.807408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:55.828403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:55.831032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:55.831032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:55.831032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:55.831032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23, user.id=9f679672201c40c7aa918017e414cc73) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:59:55.831032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:55.832063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8a41b-be44-447e-9467-563596e052e0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:55.837483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 559/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 04:59:55 2022] GET /identity/v3/role_assignments?user.id=9f679672201c40c7aa918017e414cc73&scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:57.816172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62486edc-782c-46a4-a17d-7db98eecdfd4 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:57.816723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62486edc-782c-46a4-a17d-7db98eecdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:57.816723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62486edc-782c-46a4-a17d-7db98eecdfd4 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:57.818034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 559/1118] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 04:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:59:57.823417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:57.823876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:57.823998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:57.841936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:59:57.843121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:59:57.908621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 560/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 04:59:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:59:57.932148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62486edc-782c-46a4-a17d-7db98eecdfd4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:58.006381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:58.031923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62486edc-782c-46a4-a17d-7db98eecdfd4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:58.071308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:58.071977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:58.072264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:58.072542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] PATH_INFO: `/v3/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:58.074011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] RBAC: Authorizing `identity:get_role(role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:58.075388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:58.076774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 560/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:57 2022] GET /identity/v3/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:58.083084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:58.183121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bd8a1-3ca2-4093-9285-8161b35e6d6f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:58.192509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:58.218112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:58.218783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:58.219064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:58.219340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] PATH_INFO: `/v3/users/9f679672201c40c7aa918017e414cc73` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:58.220621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] RBAC: Authorizing `identity:get_user(user_id=9f679672201c40c7aa918017e414cc73)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:58.222111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:58.224130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 561/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 04:59:58 2022] GET /identity/v3/users/9f679672201c40c7aa918017e414cc73 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:58.230952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:58.336108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa233-24d9-4e7f-8bf3-4add4fe80696 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:58.369238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:58.369878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:58.370158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:58.370432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:58.371609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:58.373076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7d09-3e05-4434-9c8c-4d2bfa330b51 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:58.374744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 561/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 04:59:58 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:59:58.382269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:59:58.490476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ff2ab-75a5-463e-9bdf-6bf60d6b8027 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:59:58.525545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:59:58.526212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:59:58.526486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:59:58.526756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23/users/9f679672201c40c7aa918017e414cc73/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:59:58.528942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ccfe4cc98e84b0b9077eeca10acaf23, user_id=9f679672201c40c7aa918017e414cc73, role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:59:58.530373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32331135-d2b4-4888-8c8e-7170dfcfde12 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:59:58.624912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 562/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 04:59:58 2022] PUT /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23/users/9f679672201c40c7aa918017e414cc73/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:00:00.702516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a9e7-1ebf-4521-b8c3-f5a651385860 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:00.703001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a9e7-1ebf-4521-b8c3-f5a651385860 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:00.703111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a9e7-1ebf-4521-b8c3-f5a651385860 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:00.704648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 562/1124] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:00.709817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:00.710279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:00.710423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:00.729760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:00.730968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:00.760601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:00.801297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 563/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:00.825304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493a9e7-1ebf-4521-b8c3-f5a651385860 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:00.838135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:00.929625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493a9e7-1ebf-4521-b8c3-f5a651385860 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:00.968169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:00.968748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:00.969027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:00.969297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] PATH_INFO: `/v3/roles/eb405a5a68874d5ea644c8a35ad443ca` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:00.970737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] RBAC: Authorizing `identity:get_role(role_id=eb405a5a68874d5ea644c8a35ad443ca)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:00.972138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:00.973473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 563/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:00 2022] GET /identity/v3/roles/eb405a5a68874d5ea644c8a35ad443ca => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:00.979497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:01.080862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec05b-04cc-4e4e-87b1-a58efd30dfe3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:01.114723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:01.115357 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:01.115636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:01.115928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] PATH_INFO: `/v3/users/9f679672201c40c7aa918017e414cc73` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:01.117100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] RBAC: Authorizing `identity:get_user(user_id=9f679672201c40c7aa918017e414cc73)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:01.119198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:01.120833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 564/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:00 2022] GET /identity/v3/users/9f679672201c40c7aa918017e414cc73 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:01.126666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:01.205634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:01.227957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0eec7-a122-4a6e-9586-e2a9ef581da0 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:01.263291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:01.263930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:01.264208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:01.264480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:01.343336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:01.344838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:01.424368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:01.446812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 564/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:01.453068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:01.486973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:01.554667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beb8bd-3fdc-485d-ad1e-a4fbd21d1e6b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:01.590685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:01.591323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:01.591607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:01.591884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] PATH_INFO: `/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:01.593235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] RBAC: Authorizing `identity:get_project(project_id=0ccfe4cc98e84b0b9077eeca10acaf23)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:01.594677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a045-9433-482c-ae20-af252bfcd63b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:01.596662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 565/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:01 2022] GET /identity/v3/projects/0ccfe4cc98e84b0b9077eeca10acaf23 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:01.602890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:01.716278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d565881-f9df-46dd-8115-94e6c6852d65 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:01.750512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:01.751041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:01.751324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:01.751598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:01.752440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] RBAC: Adding query filter params (role.id=eb405a5a68874d5ea644c8a35ad443ca, scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23, user.id=9f679672201c40c7aa918017e414cc73) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:01.752753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:01.754206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091268b-2b99-43b5-8f0c-61dbe8b128f2 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:01.760546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 565/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:00:01 2022] GET /identity/v3/role_assignments?user.id=9f679672201c40c7aa918017e414cc73&scope.project.id=0ccfe4cc98e84b0b9077eeca10acaf23&role.id=eb405a5a68874d5ea644c8a35ad443ca => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:03.799368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa949a-6b6f-4473-9553-2e1dd3dccd0e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:03.799958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa949a-6b6f-4473-9553-2e1dd3dccd0e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:03.799958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa949a-6b6f-4473-9553-2e1dd3dccd0e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:03.801316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 566/1131] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:03.807270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:03.807732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:03.807833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:03.826798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:03.828037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:03.862533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:03.893447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 566/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:00:03.918047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa949a-6b6f-4473-9553-2e1dd3dccd0e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:04.017376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa949a-6b6f-4473-9553-2e1dd3dccd0e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:04.018796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:04.051209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:04.052149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:04.052432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:04.052706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:04.053863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:04.055929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0d347-6569-45f0-bcf0-aeb1ec710f8c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:04.057528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 567/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:00:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:04.063510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:04.162496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78942f4d-2e1b-4e40-b48f-1cd8e1678644 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:04.196890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:04.197503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:04.197784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:04.198061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:04.198741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:04.200180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74d851-68f4-47df-b45b-7365460f0307 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:04.286659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 567/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 05:00:04 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:00:06.329396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145376f-75e3-4e53-809c-929fb81365c0 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:06.329930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145376f-75e3-4e53-809c-929fb81365c0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:06.329930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145376f-75e3-4e53-809c-929fb81365c0 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:06.331280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 568/1135] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:06.336470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:06.336873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:06.337016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:06.355465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:06.356680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:06.374468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:06.422783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 568/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:06.449094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145376f-75e3-4e53-809c-929fb81365c0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:06.549495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145376f-75e3-4e53-809c-929fb81365c0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:06.590272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:06.590827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:06.591109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:06.591385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:06.592546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:06.593994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd013a-73f8-4660-82d7-e1e01cdc581f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:06.595598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 569/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:00:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:06.601439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:06.698099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e34d-5297-4dee-ab37-e45db7feecf0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:06.732145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:06.732762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:06.733043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:06.733318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:06.734010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:06.735452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f36a05-f3b4-44f4-be0e-1df42069c0db None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:06.838999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 569/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 05:00:06 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:00:08.896944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e1d8-24f2-44b3-a7d4-c14a34781b0e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:08.897502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e1d8-24f2-44b3-a7d4-c14a34781b0e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:08.897502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02e1d8-24f2-44b3-a7d4-c14a34781b0e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:08.899477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 570/1139] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:08.904652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:08.905042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:08.905201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:08.923361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:08.924578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:08.927269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:08.990585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 570/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:09.013753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02e1d8-24f2-44b3-a7d4-c14a34781b0e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:09.055398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:09.114710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02e1d8-24f2-44b3-a7d4-c14a34781b0e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:09.149203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:09.149835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:09.150119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:09.150394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:09.160309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:09.165862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:09.166995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:09.168340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 571/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:09.173305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:09.269346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617c1d3-8aab-4f19-ae41-c6d077f4ac19 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:09.303674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:09.304321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:09.304603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:09.305017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:09.305784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:09.306091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:09.307464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:09.315368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 571/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:09.321270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:09.416160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:09.420122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7b42-c408-4a09-bb31-429c46624486 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:09.453683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:09.454317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:09.454599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:09.454871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] PATH_INFO: `/v3/users/21aa6cc236c44b439c2b4d5367c1ade2` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:09.467844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] RBAC: Authorizing `identity:get_user(user_id=21aa6cc236c44b439c2b4d5367c1ade2)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:09.469301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:09.470932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 572/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/users/21aa6cc236c44b439c2b4d5367c1ade2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:09.476739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:09.479638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:09.573961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4842caf-cbd1-47f8-95ef-078867a0b762 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:09.605335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:09.605933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:09.606209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:09.606479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:09.672699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:09.674132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:09.675890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:09.779551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 572/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:00:09.785664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:09.884275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02c298-2168-489e-b9eb-7bb454e46c8d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:09.916862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:09.917727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:09.917996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:09.918271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] PATH_INFO: `/v3/projects/f2457256013646e3ad383f7784cb694c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:09.919405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] RBAC: Authorizing `identity:get_project(project_id=f2457256013646e3ad383f7784cb694c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:09.920848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6cffc-e02d-403e-9d95-aea0e96d2edc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:09.922480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 573/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/projects/f2457256013646e3ad383f7784cb694c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:09.928738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:10.029361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61290c-a638-4062-972c-02699c23e93c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:10.030909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:10.063164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:10.063762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:10.064090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:10.064363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:10.065140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=f2457256013646e3ad383f7784cb694c, user.id=21aa6cc236c44b439c2b4d5367c1ade2) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:10.065447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:10.066913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8f4f3-9f41-4a77-8a53-2c1f05ad9f53 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:10.073435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 573/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:00:09 2022] GET /identity/v3/role_assignments?user.id=21aa6cc236c44b439c2b4d5367c1ade2&scope.project.id=f2457256013646e3ad383f7784cb694c&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:12.054056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087b26-2c59-48a5-a558-6cee8253e51d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.054714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087b26-2c59-48a5-a558-6cee8253e51d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.054714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01087b26-2c59-48a5-a558-6cee8253e51d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.056199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 574/1147] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:12.061408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.061828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.061964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.080243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:12.081435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:12.145915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 574/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:12.168938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01087b26-2c59-48a5-a558-6cee8253e51d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:12.193625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:12.269068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01087b26-2c59-48a5-a558-6cee8253e51d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:12.302625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:12.303261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.303543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.303817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.314424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:12.319258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:12.321141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:12.322174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 575/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:12.328185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:12.427513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:12.433377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c704-3534-434e-9ade-a45c5bd0cd4d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:12.466806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:12.467413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.467698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.468003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.468717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:12.469021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:12.470387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:12.478791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 575/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:12.484724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:12.570025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:12.586503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81924-e50f-4ea4-b5fe-6d15f7623806 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:12.620411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:12.621049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.621333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.621607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] PATH_INFO: `/v3/users/21aa6cc236c44b439c2b4d5367c1ade2` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.622773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] RBAC: Authorizing `identity:get_user(user_id=21aa6cc236c44b439c2b4d5367c1ade2)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:12.624242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:12.625862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 576/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:12 2022] GET /identity/v3/users/21aa6cc236c44b439c2b4d5367c1ade2 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:12.631677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:12.731403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b8d5f-cdea-403a-9108-8ba7821f37c1 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:12.764567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:12.765202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.765486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.765764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] PATH_INFO: `/v3/projects/f2457256013646e3ad383f7784cb694c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.766926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] RBAC: Authorizing `identity:get_project(project_id=f2457256013646e3ad383f7784cb694c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:12.768399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565e973-20e2-4d0d-a1a7-ced50b08752d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:12.770057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 576/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:12 2022] GET /identity/v3/projects/f2457256013646e3ad383f7784cb694c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:12.776767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:12.876121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914948-b798-43a6-bd0a-e320cd19edd1 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:12.913171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:12.913842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:12.914185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:12.914512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] PATH_INFO: `/v3/projects/f2457256013646e3ad383f7784cb694c/users/21aa6cc236c44b439c2b4d5367c1ade2/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:12.916446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2457256013646e3ad383f7784cb694c, user_id=21aa6cc236c44b439c2b4d5367c1ade2, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:12.918153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7667d-e9ea-42c0-9056-5e35122d445a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:12.996153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 577/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 05:00:12 2022] PUT /identity/v3/projects/f2457256013646e3ad383f7784cb694c/users/21aa6cc236c44b439c2b4d5367c1ade2/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:00:15.006535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779d18-30e4-477f-864f-a73cfddafa3d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.007075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779d18-30e4-477f-864f-a73cfddafa3d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.007075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779d18-30e4-477f-864f-a73cfddafa3d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.008906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 577/1154] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:15.014319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.014713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.014871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.033486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:15.034674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:15.043014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.102011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 578/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:00:15.126016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90779d18-30e4-477f-864f-a73cfddafa3d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:15.153610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.227898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90779d18-30e4-477f-864f-a73cfddafa3d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:15.260957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:15.261500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.261779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.262051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.272608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:15.278185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:15.279308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:00:15.284987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 578/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:15.285850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:15.383328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71399ff6-f826-4f3b-b941-2014dcea55eb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:15.417596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:15.418208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.418488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.418762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.419476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:15.419782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:15.421197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:15.429200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 579/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:15.435203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:15.517543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.531827 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa4bbb-2222-4db6-b966-6d5d50d5069f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:15.564215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:15.564853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.565177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.565470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] PATH_INFO: `/v3/users/21aa6cc236c44b439c2b4d5367c1ade2` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.566993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] RBAC: Authorizing `identity:get_user(user_id=21aa6cc236c44b439c2b4d5367c1ade2)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:15.568875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:15.571141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 579/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:15 2022] GET /identity/v3/users/21aa6cc236c44b439c2b4d5367c1ade2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:15.576966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:15.580735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.678892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c101-9ba9-479f-9f90-06f14f45cf33 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:15.713358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:15.713980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:15.714266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:15.714542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:15.780426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:15.781798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:15.784375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:15.882137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 580/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:15.888738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:15.985487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde542-b74f-4fa0-93d8-8c4a8f632e7b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:16.018124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:16.018779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:16.019012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:16.019281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] PATH_INFO: `/v3/projects/f2457256013646e3ad383f7784cb694c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:16.020447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] RBAC: Authorizing `identity:get_project(project_id=f2457256013646e3ad383f7784cb694c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:16.021869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bc400-a4d1-4774-b893-49694530ccd5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:16.024177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 580/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:15 2022] GET /identity/v3/projects/f2457256013646e3ad383f7784cb694c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:16.030389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:16.127256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af156e16-44b2-46a4-a4af-a3bf3358db40 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:16.129614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:16.161142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:16.162032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:16.162316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:16.162591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:16.163372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=f2457256013646e3ad383f7784cb694c, user.id=21aa6cc236c44b439c2b4d5367c1ade2) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:16.163681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:16.165217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b93c2-6db4-4151-a64d-e13ccd54e322 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:16.171180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 581/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:00:16 2022] GET /identity/v3/role_assignments?user.id=21aa6cc236c44b439c2b4d5367c1ade2&scope.project.id=f2457256013646e3ad383f7784cb694c&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:18.190049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1e87-30b6-4522-b45a-867aded545d5 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:18.190593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1e87-30b6-4522-b45a-867aded545d5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:18.190593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1e87-30b6-4522-b45a-867aded545d5 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:18.191950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 581/1162] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:18.197801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:18.198227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:18.198360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:18.216871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:18.218070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:18.283510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 582/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:00:18.306361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1e87-30b6-4522-b45a-867aded545d5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:18.330976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:18.405432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1e87-30b6-4522-b45a-867aded545d5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:18.438120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:18.438722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:18.439000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:18.439265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:18.503555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:18.504958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:18.527617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:18.600804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 582/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:18.606818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:18.701459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:18.705336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6e631-af56-4cb1-a67e-82ec19a3a8ce None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:18.739108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:18.739746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:18.740053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:18.740329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:18.747516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:18.749004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-e0e33e86-5861-43d9-ad8c-270c55baed33 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:18.760337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:18.761550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:18.762422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 583/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 05:00:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:18.767467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:18.863528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99070-92f5-46de-b6a7-3a3c7572bd5d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:18.887286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:18.898638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:18.899326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:18.899604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:18.899875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:18.901007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:18.901007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:18.902282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26157a82-eaf6-4e47-99f8-056dfb53e242 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:18.909377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 583/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Aug 4 05:00:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:20.912448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bf58-a4ab-425f-8326-975d81b69b36 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:20.912973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bf58-a4ab-425f-8326-975d81b69b36 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:20.912973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bf58-a4ab-425f-8326-975d81b69b36 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:20.914859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 584/1167] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:20.920275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c827a3-63a5-4ac7-9236-1c9a8c2a41da None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:20.920728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c827a3-63a5-4ac7-9236-1c9a8c2a41da None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:20.920826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c827a3-63a5-4ac7-9236-1c9a8c2a41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:20.939178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-34c827a3-63a5-4ac7-9236-1c9a8c2a41da None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:20.940385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-34c827a3-63a5-4ac7-9236-1c9a8c2a41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:21.004497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 584/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:21.026931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6bf58-a4ab-425f-8326-975d81b69b36 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:21.126210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6bf58-a4ab-425f-8326-975d81b69b36 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:21.159389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:21.160034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:21.160318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:21.160594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:21.161289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:21.162655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914412b-d0bc-44b7-978c-c811cf3fd894 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:21.253574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 585/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Aug 4 05:00:21 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:00:23.340161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502be5-5714-4317-9842-80bbd57abd69 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:23.340748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502be5-5714-4317-9842-80bbd57abd69 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:23.340748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502be5-5714-4317-9842-80bbd57abd69 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:23.342055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 585/1170] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:23.347435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:23.347885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:23.348014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:23.365603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:23.366808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:23.379631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:23.433303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 586/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:23.457933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502be5-5714-4317-9842-80bbd57abd69 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:23.558105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502be5-5714-4317-9842-80bbd57abd69 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:23.574807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:23.593694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:23.593694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:23.593694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:23.593694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] PATH_INFO: `/v3/domains/7ae30fef78764697a2e712b64ca56d09` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:23.603523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=7ae30fef78764697a2e712b64ca56d09)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:23.605074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6958e9-3bd1-4019-bee7-1483de8a0bdf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:23.606901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 586/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Aug 4 05:00:23 2022] GET /identity/v3/domains/7ae30fef78764697a2e712b64ca56d09 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:23.613726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:23.715701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5295abf-64b6-408d-a6a7-235ae8325074 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:23.749800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:23.750409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:23.750684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:23.750953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:23.751630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:23.753086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6682c5-72ef-478f-8acd-b319f21257b0 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:23.831012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:23.837949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 587/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 05:00:23 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:00:25.874315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f562-4646-4283-bd51-1ed2259cc143 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:25.874855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f562-4646-4283-bd51-1ed2259cc143 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:25.874855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f562-4646-4283-bd51-1ed2259cc143 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:25.876281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 587/1174] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:25.881451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:25.881842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:25.882009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:25.901070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:25.902262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:25.971310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 588/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:25.996992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3f562-4646-4283-bd51-1ed2259cc143 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:26.100073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3f562-4646-4283-bd51-1ed2259cc143 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:26.134088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:26.134752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:26.135032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:26.135304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] PATH_INFO: `/v3/domains/7ae30fef78764697a2e712b64ca56d09` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:26.136474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7ae30fef78764697a2e712b64ca56d09)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:26.137905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46abae-674f-4c48-87d2-03bbe8674cd5 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:26.139489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 588/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Aug 4 05:00:25 2022] GET /identity/v3/domains/7ae30fef78764697a2e712b64ca56d09 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:26.145382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:26.244147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e09c3-49e4-4425-9c19-9627aafe4935 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:26.272448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:26.278906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:26.279522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:26.279804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:26.280115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:26.280800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:26.282231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264c45-c6eb-4c61-b792-9a04a168ffd1 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:26.400242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 589/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 05:00:26 2022] POST /identity/v3/users => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:00:28.458746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c39d5-7d92-4fe4-8000-36d849d7f35d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:28.459277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c39d5-7d92-4fe4-8000-36d849d7f35d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:28.459277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c39d5-7d92-4fe4-8000-36d849d7f35d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:28.461352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 589/1178] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:28.466541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:28.466916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:28.467088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:28.484651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:28.485824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:28.552569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 590/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:28.576273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c39d5-7d92-4fe4-8000-36d849d7f35d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:28.621420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:28.677787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c39d5-7d92-4fe4-8000-36d849d7f35d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:28.710429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:28.711698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:28.712017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:28.712292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:28.722651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:28.727568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:28.728631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:00:28.729630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 590/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:28.735008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:28.834124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d1fea-d69c-4a37-9125-50c57fcd731d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:28.849830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:28.867728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:28.868365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:28.868647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:28.868920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:28.869625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:28.869928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:28.871305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:28.879780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 591/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:28.886481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:28.984514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ae472-a681-4e49-8a29-409f2544eee2 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:28.986850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.016322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:29.016942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:29.017222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:29.017491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] PATH_INFO: `/v3/users/9c2a762eba49474dbf29b9cd0e3f0294` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:29.031704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] RBAC: Authorizing `identity:get_user(user_id=9c2a762eba49474dbf29b9cd0e3f0294)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:29.033166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:29.034752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 591/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:28 2022] GET /identity/v3/users/9c2a762eba49474dbf29b9cd0e3f0294 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:29.041410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:29.138284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60f6d7-85eb-48a3-a626-84ad044b648a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:29.171328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:29.171959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:29.172240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:29.172512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:29.216338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.237468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:29.238838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:29.337739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 592/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:29.343742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:29.441239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfc5de-badc-4696-9ce1-9bf18b6217ba None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:29.473603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:29.474251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:29.474495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:29.474966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] PATH_INFO: `/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:29.476687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] RBAC: Authorizing `identity:get_project(project_id=de1366f997b44a6aa4ccb4fb3bab1121)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:29.478279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8be72-9f31-47b9-9a78-c1435f2e35f4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:29.479953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 592/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:29 2022] GET /identity/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:29.486202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:29.563267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.583827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeef37e-e649-4ce9-99c2-beb579498ddd None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:29.617391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:29.618207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:29.618337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:29.618539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:29.619311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=de1366f997b44a6aa4ccb4fb3bab1121, user.id=9c2a762eba49474dbf29b9cd0e3f0294) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:29.619614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:29.621075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee8320-4888-4d1c-a539-8225c8c7b95c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:29.626267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 593/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:00:29 2022] GET /identity/v3/role_assignments?user.id=9c2a762eba49474dbf29b9cd0e3f0294&scope.project.id=de1366f997b44a6aa4ccb4fb3bab1121&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:31.607815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca6f4-2797-49aa-927c-3ac52848501f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:31.608408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca6f4-2797-49aa-927c-3ac52848501f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:31.608502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddca6f4-2797-49aa-927c-3ac52848501f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:31.609797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 593/1186] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:31.615045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:31.615467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:31.615596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:31.633854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:31.635039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:31.703773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 594/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:31.726383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddca6f4-2797-49aa-927c-3ac52848501f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:31.756406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:31.828513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddca6f4-2797-49aa-927c-3ac52848501f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:31.861462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:31.862105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:31.862385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:31.862658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:31.873309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:31.878261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:31.879253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:00:31.880301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 594/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:31.886698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:31.958002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:31.990701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599190-414b-4f9b-a0ee-a58acade1282 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:32.025382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:32.026014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:32.026294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:32.026570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:32.027299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:32.027605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:32.029059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:32.037982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 595/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:32.045468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:32.137157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:32.146480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644327d6-b1f9-4b54-8560-3a11f222c0a3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:32.180882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:32.181497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:32.181774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:32.182044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] PATH_INFO: `/v3/users/9c2a762eba49474dbf29b9cd0e3f0294` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:32.183191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] RBAC: Authorizing `identity:get_user(user_id=9c2a762eba49474dbf29b9cd0e3f0294)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:32.184641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:32.186207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 595/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:32 2022] GET /identity/v3/users/9c2a762eba49474dbf29b9cd0e3f0294 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:32.192042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:32.291066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95031e-5ca5-4a17-af3e-8b0518b5bf4f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:32.326640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] PATH_INFO: `/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] RBAC: Authorizing `identity:get_project(project_id=de1366f997b44a6aa4ccb4fb3bab1121)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e8756-ba78-431e-8a4a-a8c42ac5bd17 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:32.332506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 596/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:32 2022] GET /identity/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:32.338677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:32.435181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47e25-68b3-4a10-a5bb-f0dab37528b4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:32.468460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:32.469115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:32.469395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:32.469668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] PATH_INFO: `/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121/users/9c2a762eba49474dbf29b9cd0e3f0294/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:32.471595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] RBAC: Authorizing `identity:create_grant(project_id=de1366f997b44a6aa4ccb4fb3bab1121, user_id=9c2a762eba49474dbf29b9cd0e3f0294, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:32.473057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfd727-3454-4f5d-9bf3-379fa18a477d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:32.569381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 596/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 05:00:32 2022] PUT /identity/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121/users/9c2a762eba49474dbf29b9cd0e3f0294/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:00:34.604840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99f77-bad1-446a-9437-56dfb016b136 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:34.605378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99f77-bad1-446a-9437-56dfb016b136 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:34.605378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99f77-bad1-446a-9437-56dfb016b136 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:34.606802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 597/1193] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:00:34.611829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:34.612248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:34.612412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:34.630466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:00:34.631632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:00:34.645510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:34.700065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 597/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:00:34.721974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd99f77-bad1-446a-9437-56dfb016b136 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:34.724887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:34.823257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd99f77-bad1-446a-9437-56dfb016b136 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:34.856134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:34.856696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:34.856973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:34.857244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:34.867478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:00:34.872335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:00:34.873330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:00:34.874220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 598/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:00:34.880260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:34.979881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82169ee5-62ae-48dc-8e33-bd456e4e2cdf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:35.012857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:35.013464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:35.013747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:35.014024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:35.014736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:35.015041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:35.016439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:35.025172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 598/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:00:35.031092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:35.091871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:35.130319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729c4d2-f7fc-4c80-a4db-4af1699e6129 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:35.163090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:35.164309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:35.164585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:35.164855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] PATH_INFO: `/v3/users/9c2a762eba49474dbf29b9cd0e3f0294` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:35.165997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] RBAC: Authorizing `identity:get_user(user_id=9c2a762eba49474dbf29b9cd0e3f0294)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:35.167681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:35.169289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 599/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Aug 4 05:00:35 2022] GET /identity/v3/users/9c2a762eba49474dbf29b9cd0e3f0294 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:35.175142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:35.188257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:35.274343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92071a-f6cf-428c-9a59-6c81eb351d28 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:35.306525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301805-822f-4481-a165-e993dad56849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:35.307124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301805-822f-4481-a165-e993dad56849 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:35.307401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301805-822f-4481-a165-e993dad56849 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:35.307669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301805-822f-4481-a165-e993dad56849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:35.373008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301805-822f-4481-a165-e993dad56849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:35.374448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301805-822f-4481-a165-e993dad56849 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:35.386525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:35.470240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 599/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:00:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:00:35.476348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:35.575297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98808b4-0dd6-4e22-bb41-7ef4c9f36757 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:35.602923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:35.608754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:35.609396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:35.609671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:35.616287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] PATH_INFO: `/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:35.616287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] RBAC: Authorizing `identity:get_project(project_id=de1366f997b44a6aa4ccb4fb3bab1121)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:35.616287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342b5c-8c9a-4858-ad91-7a6bfb35033d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:35.616287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 600/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Aug 4 05:00:35 2022] GET /identity/v3/projects/de1366f997b44a6aa4ccb4fb3bab1121 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:35.620980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301805-822f-4481-a165-e993dad56849 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:00:35.729175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301805-822f-4481-a165-e993dad56849 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:00:35.739865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:35.763813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:00:35.764454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:00:35.764731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:00:35.765004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:00:35.765783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=de1366f997b44a6aa4ccb4fb3bab1121, user.id=9c2a762eba49474dbf29b9cd0e3f0294) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:00:35.766088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:00:35.767535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7660a8-ce66-4504-a792-b2ea309c1030 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:00:35.773524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 600/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:00:35 2022] GET /identity/v3/role_assignments?user.id=9c2a762eba49474dbf29b9cd0e3f0294&scope.project.id=de1366f997b44a6aa4ccb4fb3bab1121&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:00:45.634769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:45.786880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=13 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:49.552179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73af2-b6e1-4362-8191-dafa12dde44d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:49.552786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73af2-b6e1-4362-8191-dafa12dde44d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:49.552786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73af2-b6e1-4362-8191-dafa12dde44d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:49.554305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 601/1201] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:01:49.560168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:49.563053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:49.563053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:49.579307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:01:49.580654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:01:49.648222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 601/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:01:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:01:49.673129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73af2-b6e1-4362-8191-dafa12dde44d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:49.780976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73af2-b6e1-4362-8191-dafa12dde44d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:49.816599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:49.817147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:49.817425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:49.817701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:49.829236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:49.830846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:01:49.846033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:49.847209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:49.854301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:01:49.854301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:01:49.854301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:49.854301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:01:49.854301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 602/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:49.854654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:49.953287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523fca6-d3b2-4a0f-8426-ce41fc3e0d3f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:49.983532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:49.989295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:49.991181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:49.991181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:49.991181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:49.991181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:49.991519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:49.992835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c634234-672f-41de-9dc4-75ce099345f3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:50.003920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 602/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:50.009803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:50.064311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:50.112148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb15b-1233-4803-be04-3717d2ec330d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:50.146540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:50.147255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:50.147544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:50.147821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:50.148547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:50.150790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb72a0-98ee-4465-b876-6ab9157e06df None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:50.259973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 603/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Aug 4 05:01:50 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:01:52.301233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e545bc-1ebd-446d-9f6e-32923a5d5eb6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:52.301819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e545bc-1ebd-446d-9f6e-32923a5d5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:52.301819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e545bc-1ebd-446d-9f6e-32923a5d5eb6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:52.303157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 603/1206] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:01:52.309046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:52.309469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:52.309571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:52.327852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:01:52.329068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:01:52.394862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 604/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:01:52.419800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e545bc-1ebd-446d-9f6e-32923a5d5eb6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:52.520584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e545bc-1ebd-446d-9f6e-32923a5d5eb6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:52.553892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:52.554441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:52.554718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:52.555548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:52.568651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:01:52.573760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:52.574930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:01:52.575802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:52.580279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 604/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 05:01:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:52.581242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:52.622796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:52.683600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157978c-cb7c-40ca-93e8-c5e4f12f5495 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:52.720754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:52.721381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:52.721665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:52.721943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:52.722661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:52.722967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:52.724403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:52.733147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 605/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 05:01:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:52.739124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:52.788217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:52.839395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1635e10-3d5f-4c05-bb6c-dde06c7da34e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:52.876553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:52.877219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:52.877500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:52.877774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:52.888707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:52.892940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:01:52.905242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:52.906340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:52.907488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:01:52.907488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:01:52.907488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:52.907488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:52.907488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 605/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:52.912453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.025998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:53.029156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c1c00-6d42-4f83-9e08-a688a70a6852 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:53.064685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:53.065315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:53.065592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:53.065870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:53.066565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:53.066867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:53.068293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:53.081132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 606/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:53.088637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.189718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1051-2681-4705-b255-b34f0897549d None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:53.191240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:53.227868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:53.228541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:53.228822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:53.229094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:53.237086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:53.238532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:01:53.251074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:53.254523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:53.255719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 606/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:53.259007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.359676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee2091-149c-4b0e-94ab-77b7a6901db8 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:53.394075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:53.394689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:53.394968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:53.395239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:53.396055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:53.396362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:53.397794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:53.416125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 607/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:01:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:01:53.421977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.524313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a8-6bfc-4ca9-99c2-4edc128e2f8f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:53.557667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:53.558276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:53.558556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:53.558830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:53.589638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:53.628411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:53.629870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:53.731977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 607/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:01:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:01:53.738004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.757308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:53.838744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b9e39-8cf0-4450-b229-e9d22e2d77ef None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:53.873817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:53.874460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:53.874738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:53.875012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:53.885263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:53.886725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:01:53.902944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:53.904238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:53.905430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:01:53.905430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:01:53.905430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:53.905430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:01:53.905430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 608/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:53.910090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:53.971630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:54.010003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b3a10-03d8-40dd-bf95-77469777ba1e None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:54.043956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:54.044597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:54.044878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:54.045150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:54.045889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:54.046210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:54.047577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:54.059638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 608/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:54.065415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:54.133615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:54.163195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc2c5-35ff-4582-8707-8c585cf38968 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:54.198652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:54.199287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:54.199569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:54.199840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:54.206758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:54.208247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:01:54.220329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:54.221509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:01:54.222795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 609/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:54.228170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:54.328172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3ee4-a69e-49fa-a93c-1bebce354d53 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:54.350348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:54.362163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:54.362776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:54.363054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:54.363323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:54.364107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:54.364395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:54.365819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a34b-3370-486c-9fc0-271d9e4c83ab None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:54.377987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 609/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:54.384558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:54.486630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d54ad-a1b8-4276-b0c0-38d34ab8861b None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:54.515006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:54.520919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:54.521742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:54.522032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:54.522304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:54.526108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=b6b3afafa65b40f6a20461377a7f57a0) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:54.526108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:54.526108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb19fa-8ff5-4bfb-9233-9bdd58537acc None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:54.531765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 610/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:01:54 2022] GET /identity/v3/role_assignments?user.id=b6b3afafa65b40f6a20461377a7f57a0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:56.521738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e912f-d6ba-42c4-a421-053655f3a62f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:56.522308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e912f-d6ba-42c4-a421-053655f3a62f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:56.522308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e912f-d6ba-42c4-a421-053655f3a62f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:56.523965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 610/1220] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:01:56.529465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:56.529876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:56.530023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:56.549421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:01:56.550637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:01:56.619643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 611/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:01:56.642433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e912f-d6ba-42c4-a421-053655f3a62f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:56.746256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e912f-d6ba-42c4-a421-053655f3a62f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:56.780913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:56.781454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:56.781738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:56.782016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:56.793558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:01:56.798503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:56.799731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:56.800857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 611/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 05:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:56.806293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:56.905852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf209-0266-405c-8033-2931cc4be5cd None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:56.932400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:56.943601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:56.944256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:56.944541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:56.944813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:56.945527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:56.945836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:56.947201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:56.955199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 612/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 05:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:56.961862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.007389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:57.062299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a554b-fdd5-422b-b80d-91b5d3708f79 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.095539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.096194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.096474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.096747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.108222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.109765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:01:57.124964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:57.125878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:57.126825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:01:57.126825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:01:57.126825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:57.126825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:57.126825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 612/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:57.132145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.231778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1895363-edf8-4eee-b724-ac58c8fc6f35 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.264793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.265409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.265691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.265965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.266644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:57.266951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.268469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.281062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 613/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:57.286911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.379739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:57.386765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac5e6-472d-442c-9f8f-f244ee00fd8f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.418602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.419224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.419503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.419775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.426935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.428408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:01:57.440106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:57.441281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:57.442461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 613/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:57.447812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.493236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:57.545520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63079bfe-fe87-49f2-a879-e977d2e70baa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.578377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.578999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.579316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.579604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.580428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:57.587063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.587063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.599426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 614/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:57.605937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.709653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb11e5-4991-4abb-b9fa-cb83cf1c7fa3 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.746113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.746742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.747019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.747292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.757668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.759755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:01:57.774460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:57.775516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:57.776666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:01:57.776666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:01:57.776666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:01:57.776666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:57.776666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 614/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:57.781463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.880714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d42-55ba-42fa-a2a7-db3cb838d76c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:57.883039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:57.916230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:57.916846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:57.917124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:57.917398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:57.918079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:57.918380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:57.919748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:57.931947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 615/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:57.937698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:57.947276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:58.038222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f75d-6e63-4833-a68f-4572e0981f01 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:58.071912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:58.072563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:58.072846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:58.073122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:58.079747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:58.081270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:01:58.093082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:01:58.094234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:01:58.095340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 615/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:01:58.100348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:58.199313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85564e9-923b-4914-a3fa-6a64e8c9a11c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:58.233046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:58.233656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:58.233932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:58.234198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:58.234936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:01:58.235236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:58.236693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d37d-c3d6-4c09-84e6-58df79dcbdc6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:58.248767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 616/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:01:58.254815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:01:58.323282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:58.358741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c028-4cbd-42fc-8ff5-4a28a8d01c27 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:01:58.392117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:01:58.392777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:01:58.393055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:01:58.393327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/b6b3afafa65b40f6a20461377a7f57a0/roles/b19d17e525b4405fb8159941130f602d` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:01:58.408068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=b6b3afafa65b40f6a20461377a7f57a0, role_id=b19d17e525b4405fb8159941130f602d)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:01:58.409498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2d9c1-a031-40ec-83f4-5f13a6b09375 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:01:58.489167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 616/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 05:01:58 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/b6b3afafa65b40f6a20461377a7f57a0/roles/b19d17e525b4405fb8159941130f602d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:02:00.496902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7afe-f0f0-433c-837c-2e46f5c6f779 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:00.497532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7afe-f0f0-433c-837c-2e46f5c6f779 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:00.497532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7afe-f0f0-433c-837c-2e46f5c6f779 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:00.498843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 617/1233] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:00.505481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:00.505934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:00.506035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:00.525633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:00.526850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:00.603556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 617/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 05:02:00.637813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a7afe-f0f0-433c-837c-2e46f5c6f779 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:00.666043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:00.750782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a7afe-f0f0-433c-837c-2e46f5c6f779 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:00.787791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:00.788465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:00.788787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:00.789047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:00.800225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:02:00.807129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:00.808332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:00.809544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 618/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Aug 4 05:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:00.814440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:00.865460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:00.923528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e94e0-a3fd-42ac-a6dc-8f8d989a670d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:00.965652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:00.966336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:00.966608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:00.966876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:00.967603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:00.967889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:00.974764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:00.978495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 618/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Aug 4 05:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:00.987009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.079926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:01.095959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1394-8c3c-4b81-bf2e-2c1a3d8852b9 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:01.130122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:01.135225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:01.135225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:01.135225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:01.141803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:01.143283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:01.157863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:01.158788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:01.159744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:01.159744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:01.159744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:01.159744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:01.159744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 619/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:01.165801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.267194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325caf4-5d1f-4c38-a0e5-e8b2b5d25cf6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:01.277015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:01.302212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:01.302826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:01.303108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:01.303382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:01.304103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:01.304504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:01.306027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:01.317726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 619/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:01.324233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.424575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d8309-f925-4071-85ae-2ccc4e48321e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:01.458118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:01.458755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:01.459041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:01.459317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:01.462766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:01.467734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:01.469211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:02:01.480882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:01.482021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:01.483234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 620/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:01.488367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.589631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435dcda-cd3f-4b2b-b9cd-137b77acbab6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:01.622359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:01.622969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:01.623250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:01.623526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:01.624340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:01.624645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:01.626127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:01.643294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 620/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:02:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:01.649911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.751133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23109-3528-4474-a058-7681a6a7fd8f None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:01.784496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:01.785112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:01.785391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:01.785666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:01.845818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:01.852665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:01.854115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:01.950634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 621/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:02:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:02:01.956420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:01.984791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:02.057446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32842-ae81-40d0-9d07-660b37118fbc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:02.090487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:02.091108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:02.091383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:02.091651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:02.101374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:02.102834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:02.121750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:02.122910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:02.124188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:02.124188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:02.124188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:02.124188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:02.124188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 621/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:02.128886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:02.221988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:02.227514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8bfd-93b5-4f57-b7aa-dace37e234b6 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:02.260452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:02.261108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:02.261392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:02.261666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:02.262350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:02.262653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:02.264149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:02.275992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 622/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:02.281816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:02.358972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:02.379188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde5159-f94d-4155-b4cc-360bcc688f4f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:02.411980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:02.412611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:02.412894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:02.413169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:02.420380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:02.422273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:02:02.434193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:02.439433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:02.440566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 622/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:02.441589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:02.544190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb65b-41a6-42cd-8298-81cc18daf104 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:02.578511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:02.579124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:02.579406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:02.579714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:02.580487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:02.580801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:02.582353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc51f5-b146-4766-950c-0eae40671d59 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:02.594583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 623/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:02.600845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:02.698905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaaf90-4804-466c-977f-18c1d6f904a4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:02.731634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:02.732315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:02.732590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:02.732863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:02.733636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] RBAC: Adding query filter params (role.id=b19d17e525b4405fb8159941130f602d, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=b6b3afafa65b40f6a20461377a7f57a0) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:02.733940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:02.735348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa327d6-c1da-496b-9849-50fa663541b3 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:02.740897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 623/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:02:02 2022] GET /identity/v3/role_assignments?user.id=b6b3afafa65b40f6a20461377a7f57a0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=b19d17e525b4405fb8159941130f602d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:04.781073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765feb2-31d6-42a9-ab7b-1c411d808d39 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:04.781593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765feb2-31d6-42a9-ab7b-1c411d808d39 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:04.781708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765feb2-31d6-42a9-ab7b-1c411d808d39 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:04.782997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 624/1247] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:04.788065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:04.788542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:04.788633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:04.795655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:04.807445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:04.808647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:04.872798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 624/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:04.896047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765feb2-31d6-42a9-ab7b-1c411d808d39 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:04.916078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:04.999475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765feb2-31d6-42a9-ab7b-1c411d808d39 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.033747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.035440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.035440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.035440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.045960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:02:05.050887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:05.052095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:05.053391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 625/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:05.058370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.160304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216ea1a-2a9a-428a-bf85-4ff930012342 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.188604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:05.193406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.194006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.194286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.194562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.195269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:05.196136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:05.197542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:05.205485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 625/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:05.212256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.290646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:05.312635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067af8b4-76c6-4a26-b81e-1b16ac4eb85e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.346043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.346675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.346954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.347226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.357673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:05.359102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:05.373146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:05.374218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:05.375191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:05.375191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:05.375191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:05.375191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:05.375191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 626/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:05.380581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.480062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113649f-f1bb-4a01-a98e-683ec83d44fd None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.515076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.515713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.516024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.516301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.516987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:05.517475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:05.518661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:05.530435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 626/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:05.536256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.638021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ab30-8462-4f8c-a154-c82d7b31bc0e None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.663181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:05.671126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.671756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.672073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.672368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.679535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:05.681821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:02:05.692763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:05.693854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:05.694873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 627/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:02:05.700573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.755650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:05.799553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db922655-8c63-408f-b332-acb5724e8dc6 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.833174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.833782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.834074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:05.834334 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:05.835202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:05.835513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:05.837116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:05.855411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 627/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:05.861413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:05.963957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccacc1-f3ee-49c2-9dd4-327739582a79 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:05.999014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:05.999653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:05.999926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.000231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.058961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:06.071030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.072521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.171414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 628/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:02:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 05:02:06.177203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:06.276657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed09-a5f3-46f2-b8c4-c55d9b7e3dba None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:06.290367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:06.310471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:06.311098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:06.311377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.311651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.321304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.322740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:06.337764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:06.338847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:06.340159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:06.340159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:06.340159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:06.340159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:06.343516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 628/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:06.344648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:06.430494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:06.441932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4fa7a-a38f-402c-8fb1-acacef591d01 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:06.484772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:06.485384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:06.485660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.485934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.486654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:06.487040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.488373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.499682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 629/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:06.505445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:06.606599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb46da-cfcf-4b0b-8bb1-103fd472523b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:06.640374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:06.640999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:06.641279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.641555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.649125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.650574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:02:06.662010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:06.666056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:06.667195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 629/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:06.669422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:06.768861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465fbb2-512b-4b40-b647-9d5add2b5e43 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:06.804460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:06.805273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:06.805562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.805840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.806583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:06.806892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.808494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b221-061b-4aec-a661-25301b22f2ee None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.821401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 630/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:06.827664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:06.854609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:06.929249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9b5c-8316-459e-ae7f-65e925fbaf59 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:06.963378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:06.964028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:06.964310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:06.964587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:06.965373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=b6b3afafa65b40f6a20461377a7f57a0) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:06.965685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:06.967111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb1fb2-0392-454a-9346-3f677af7d747 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:06.972545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 630/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:02:06 2022] GET /identity/v3/role_assignments?user.id=b6b3afafa65b40f6a20461377a7f57a0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:02:08.957649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1076442-e0c5-4730-9676-ddc96ad84aa7 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:08.958214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1076442-e0c5-4730-9676-ddc96ad84aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:08.958214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1076442-e0c5-4730-9676-ddc96ad84aa7 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:08.959483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 631/1261] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:08.964694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:08.973047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:08.973047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:08.983538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:08.984753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:09.054411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 631/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:09.077817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1076442-e0c5-4730-9676-ddc96ad84aa7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.089042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:09.181108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1076442-e0c5-4730-9676-ddc96ad84aa7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:09.215344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:09.215933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:09.216216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:09.216486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:09.226318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:02:09.231880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:09.233023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:09.233931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 632/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:09.239233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.257212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:09.337642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a099-9199-4603-ae44-f300f5e4daff None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:09.372099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:09.372734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:09.373017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:09.373291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:09.373998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:09.374298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:09.375674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:09.383491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 632/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:09.389757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.458773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:09.493051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd12ff-7c39-4c8b-acae-fd1f1f87e78c None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:09.525946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:09.526576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:09.530454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:09.530454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:09.536779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:09.538218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:09.553341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:09.558455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:09.559586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:09.559586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:09.559586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:09.559586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:09.559586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 633/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:09.560459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.643752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:09.663486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2114-e6c7-4b99-8222-b2e76b4838b9 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:09.700305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:09.700953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:09.701236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:09.701539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:09.702238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:09.702541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:09.703937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:09.716594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 633/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:09.722264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.820220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698f70-3900-4ad7-a774-6dc860f73f00 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:09.840112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:09.853412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:09.854048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:09.854329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:09.854600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:09.862806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:09.864278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:02:09.875219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:09.877578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:09.878714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 634/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 05:02:09.882306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:09.984307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b4da-8741-4842-bb27-2838549909a4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.018779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.019390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.019685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.020076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.020869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:10.021188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.022624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.031353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:10.039660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 634/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:02:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:10.045741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:10.146952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a4f0a-b833-4e01-a8b8-0078694447c5 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.182271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.182907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.183181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.183452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.193955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.196594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:10.211099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:10.212302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:10.213403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:10.213403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:10.213403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:10.213403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:10.213403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 635/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:10.218303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:10.318612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcfaf8-4d9c-4b99-8f68-5f46fa726fb4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.352236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.353081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.353385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.353655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.354356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:10.354654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.356042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.366888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 635/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:10.373355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:10.405061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:10.473905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe3ce5-dab8-4dc3-9ce0-fe90701a07ce None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.507784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.508478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.508759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.509034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.515463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.516914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:02:10.527960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:10.528992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:10.529952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 636/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:10.536953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:10.594592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:10.635328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf175-af75-4084-bb78-33e6b5c9af02 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.670219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.670788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.671072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.671346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.672112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:10.672425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.673851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce203bb-9e86-4faf-8d02-d23b0316f0fb None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.686161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 636/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:10.692254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:10.791095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:10.799477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f7-8fcb-4b1f-b5eb-03160a076b81 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:10.831924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:10.832610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:10.832889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:10.833165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] PATH_INFO: `/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/b6b3afafa65b40f6a20461377a7f57a0/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:10.835096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=552b91bdd18248fcb34187159a5a1aad, user_id=b6b3afafa65b40f6a20461377a7f57a0, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:10.837129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f51f7-db39-47cf-8bbe-b5987cbb5dc6 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:10.938849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 637/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Aug 4 05:02:10 2022] PUT /identity/v3/projects/552b91bdd18248fcb34187159a5a1aad/users/b6b3afafa65b40f6a20461377a7f57a0/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:02:12.925780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d17-c0d3-4209-8981-ea232eb656b6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:12.926320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d17-c0d3-4209-8981-ea232eb656b6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:12.926320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09d17-c0d3-4209-8981-ea232eb656b6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:12.927679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 637/1274] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:12.933406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:12.933831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:12.933944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:12.952317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:12.953419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:13.019399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 638/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:13.042523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd09d17-c0d3-4209-8981-ea232eb656b6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.151912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd09d17-c0d3-4209-8981-ea232eb656b6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.169332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:13.186433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.187071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.187363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.187625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:13.198504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 05:02:13.203619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:13.204673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:13.205624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 638/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:13.211071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.291268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:13.309810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400010db-d8f2-4794-a504-b9a4e4a6bc47 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.342972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.343585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.343867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.344174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:13.344891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:13.345191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:13.346557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:13.355846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 639/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:13.361839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.469798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84278-f490-41a0-a81b-b489c1a0a41f None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.505709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.506353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.506632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.506909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:13.517267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:13.518720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:13.533582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:13.534689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:13.535607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:13.535607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:13.535607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:13.535607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:13.535607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 639/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:13.541846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.648043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ba060-4ce5-48e6-8382-2d608c622450 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.683872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.684510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.684786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.685056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:13.685736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:13.686038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:13.687448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:13.699176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 640/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:13.704575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.738255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:13.803232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a617-25d5-4f01-9da6-af8eb8893579 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.836955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.837586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.837866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.838141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:13.845336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:13.846789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 05:02:13.859299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:13.860573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:13.861574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 640/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:13.866363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:13.870935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:13.964978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5115-f06d-4511-a2f9-83052f4e3a7d None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:13.998504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:13.999052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:13.999334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:13.999609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.000506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:14.000819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.002254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.019345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 641/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Aug 4 05:02:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:14.025907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:14.116676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:14.125931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cedfba-d546-4257-a556-2676ab922db4 None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:14.159315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:14.159947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:14.160293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:14.160550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.225965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.227469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.312755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:14.322960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 641/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 05:02:14.328758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:14.389673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:14.427587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d88c-93c9-4e92-ad87-9fef319d946a None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:14.461873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:14.462567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:14.462856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:14.463132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.473098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.474543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 05:02:14.489211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:14.490283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:14.491633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 05:02:14.491633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 05:02:14.491633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 05:02:14.491633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:14.491633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 642/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:14.496736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:14.595009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5ba6-2b34-45b6-8ac9-3cade09803ef None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:14.627823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:14.628457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:14.628736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:14.629029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.629711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:14.630012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.631380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.643094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 642/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:14.649367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:14.748591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da34-262f-4e58-9ca6-74b5aa4b17aa None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:14.761781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:14.781460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:14.782109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:14.782366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:14.782637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.789144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.791339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 05:02:14.803256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:14.804461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: ERROR keystone.server.flask.application Aug 04 05:02:14.805645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 643/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:14.810568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:14.860448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:14.909147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788354a8-21c7-467c-a6b6-94e25630054c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:14.941754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:14.942399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:14.942673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:14.942948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:14.943746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:14.944091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:14.946017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f27c-bed3-40e7-9550-c8fcc5a8785d None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:14.958360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 643/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:14.965560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:15.061456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b501d1-a8f5-4400-a11d-52dcf95145f2 None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:15.095656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:15.096317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:15.096602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:15.096879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:15.097705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] RBAC: Adding query filter params (role.id=5a02b24f89c148f78d88275904494739, scope.project.id=552b91bdd18248fcb34187159a5a1aad, user.id=b6b3afafa65b40f6a20461377a7f57a0) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:15.098014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:15.099469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238505-d178-44b1-a6a2-6756fd450d5c None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:15.106377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 644/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Aug 4 05:02:14 2022] GET /identity/v3/role_assignments?user.id=b6b3afafa65b40f6a20461377a7f57a0&scope.project.id=552b91bdd18248fcb34187159a5a1aad&role.id=5a02b24f89c148f78d88275904494739 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:17.103573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2198d9-89a7-414f-a7ac-4566ac936396 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:17.104100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2198d9-89a7-414f-a7ac-4566ac936396 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:17.104100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2198d9-89a7-414f-a7ac-4566ac936396 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:17.105501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 644/1288] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:17.110799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:17.111214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:17.111491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:17.129942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:17.144517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:17.162554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:17.200084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 645/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:17.222682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2198d9-89a7-414f-a7ac-4566ac936396 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:17.323740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2198d9-89a7-414f-a7ac-4566ac936396 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:17.334112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:17.357638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534633-139b-4877-af74-23870d3e63fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:17.358200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534633-139b-4877-af74-23870d3e63fc None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:17.358480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534633-139b-4877-af74-23870d3e63fc None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:17.358753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534633-139b-4877-af74-23870d3e63fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:17.359378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534633-139b-4877-af74-23870d3e63fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:17.360773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43534633-139b-4877-af74-23870d3e63fc None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-43534633-139b-4877-af74-23870d3e63fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:17.370232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:17.371475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:17.372849 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 645/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 05:02:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:17.377590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:17.478760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04283be9-4931-41b3-8da5-f7687dda62c3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:17.513820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:17.514464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:17.514748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:17.515026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:17.515723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:17.516068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:17.517689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95652c3-9a35-4261-8cac-6b8bc60eccbe None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:17.529208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 646/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 05:02:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:17.530982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534633-139b-4877-af74-23870d3e63fc None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:17.646685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534633-139b-4877-af74-23870d3e63fc None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:17.683507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:17.684164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:17.684444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:17.684715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] PATH_INFO: `/v3/services` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:17.685402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] RBAC: Adding query filter params (type=placement) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:17.685702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:17.687090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8cc75-e3b5-479b-9bc1-d22436c69caf None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:17.693837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 646/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 05:02:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:19.702237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a707-75e6-41af-b374-d030d16ff824 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:19.702656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a707-75e6-41af-b374-d030d16ff824 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:19.702791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a707-75e6-41af-b374-d030d16ff824 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:19.704203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 647/1293] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:19.709925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2344-4f7d-45dc-9542-19647eb39cad None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:19.710312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2344-4f7d-45dc-9542-19647eb39cad None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:19.710480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2344-4f7d-45dc-9542-19647eb39cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:19.729931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-826a2344-4f7d-45dc-9542-19647eb39cad None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:19.731111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-826a2344-4f7d-45dc-9542-19647eb39cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:19.759481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:19.796944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 647/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:19.819605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a707-75e6-41af-b374-d030d16ff824 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:19.850971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:19.921181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a707-75e6-41af-b374-d030d16ff824 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:19.954088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:19.954633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:19.954914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:19.955189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:19.955879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:19.957267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fcafc-f025-416a-8d3a-1b38c321afe2 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:20.064894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 648/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Aug 4 05:02:19 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:02:22.064877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6e27-b79b-454c-9893-89d084faf95e None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.065380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6e27-b79b-454c-9893-89d084faf95e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.065380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6e27-b79b-454c-9893-89d084faf95e None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.066683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 648/1296] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:22.072084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.072494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.072662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.091392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:22.092623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:22.165395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 649/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:22.187488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6e27-b79b-454c-9893-89d084faf95e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:22.285477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6e27-b79b-454c-9893-89d084faf95e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:22.319203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:22.319772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.320083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.320889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.321668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:22.323020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:22.331729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:22.332945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:22.334101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 649/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 05:02:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:22.339728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:22.357800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:22.437838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40635224-ecc4-4b7b-8d22-f78354a18538 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:22.473193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:22.473800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.474080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.474350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.475020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] RBAC: Adding query filter params (name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:22.475321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:22.476790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:22.481788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 650/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 05:02:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:22.488058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:22.519413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:22.587522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f888f-b4f1-4edd-a344-efc537f6250b None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:22.620205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:22.620810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.621092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.621366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.622146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] RBAC: Adding query filter params (interface=public, service_id=be7d586f645f45dbb0a2f6c674074527, region_id=RegionOne) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:22.622455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:22.623821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172e5e2-4da6-462d-9e7a-87b58d640dd6 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:22.628765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 650/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Aug 4 05:02:22 2022] GET /identity/v3/endpoints?service_id=be7d586f645f45dbb0a2f6c674074527&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:22.635233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:22.716877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:22.734850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1b23-2bbe-47da-b6af-175a1fa3a4df None admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:22.769262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:22.769870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:22.770151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:22.770426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:22.771068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:22.772475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204258-bbfd-4c6b-afcd-dbabf83b83ab None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:22.779253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 651/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Aug 4 05:02:22 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:02:24.771196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58e8-2173-488d-a5c4-be7a525957d6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:24.771823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58e8-2173-488d-a5c4-be7a525957d6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:24.771823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58e8-2173-488d-a5c4-be7a525957d6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:24.773132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 651/1302] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:02:24.778446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:24.778877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:24.779000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:24.798088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:02:24.799279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:02:24.864825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 652/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:02:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 05:02:24.888491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac58e8-2173-488d-a5c4-be7a525957d6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:24.984744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:24.991289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac58e8-2173-488d-a5c4-be7a525957d6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:25.025072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:25.025704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:25.025985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:25.026257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:25.026887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:25.028305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 05:02:25.036983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 05:02:25.042028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application with Lock( Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self._enter() Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application return self.creator() Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application created_value = creator( Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: ERROR keystone.server.flask.application Aug 04 05:02:25.043204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 652/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Aug 4 05:02:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 05:02:25.045500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:25.120453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:25.142006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002093-e994-4a07-a005-8c57f21439a7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:25.176597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:25.177199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:25.177477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:25.177749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] PATH_INFO: `/v3/services` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:25.178416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:02:25.178723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:25.180334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0937-83e9-49e7-96c9-cb901c7f81f9 None admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:25.185341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 653/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Aug 4 05:02:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:02:25.191219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:02:25.297591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b463d7-3117-4809-b475-dd10e03a2c2c None admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:02:25.330755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:02:25.331372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:02:25.331643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:02:25.331945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:02:25.332664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:02:25.334066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af4ed-14e9-4cd0-8ef6-dd8652f59ee1 None admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:02:25.436019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 653/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:02:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:02:35.182340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=30 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:35.431404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:56.940119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c38f-f2a2-413a-91f4-e3b0af4fa82d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:56.941240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c38f-f2a2-413a-91f4-e3b0af4fa82d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:56.941765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6c38f-f2a2-413a-91f4-e3b0af4fa82d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:56.956418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78487-8b09-4f35-8a19-5399b9377274 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:56.958955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78487-8b09-4f35-8a19-5399b9377274 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:56.960510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78487-8b09-4f35-8a19-5399b9377274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:56.964373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 654/1307] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:08:56 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:57.140212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-edc78487-8b09-4f35-8a19-5399b9377274 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:57.141435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-edc78487-8b09-4f35-8a19-5399b9377274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:57.300096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 654/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:08:57.352582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:57.352866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:57.353457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:57.355057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 655/1309] 10.222.0.36 () {54 vars in 965 bytes} [Thu Aug 4 05:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:08:57.363347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659ca8-45ec-4293-b79f-fabdc77c119b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:57.364171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659ca8-45ec-4293-b79f-fabdc77c119b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:57.364709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659ca8-45ec-4293-b79f-fabdc77c119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:57.454350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-30659ca8-45ec-4293-b79f-fabdc77c119b None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:08:57.455926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-30659ca8-45ec-4293-b79f-fabdc77c119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:57.478220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:57.539991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 655/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Aug 4 05:08:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:08:57.549643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:08:57.551389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:57.674365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f4849-2be9-48d7-b08c-1143405690e7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:08:57.773104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:08:57.773741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:08:57.774026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:08:57.774299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:08:57.776120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:08:57.846624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:08:57.909394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:08:57.911005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8d5bd-f1f1-41f7-b907-6bc8e09cd112 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:08:57.931149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 656/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:00.443570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:00.444124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:00.444124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:00.445694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 656/1312] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:00.451141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59970b-3e59-4a13-b1ad-949952355b7c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:00.451704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59970b-3e59-4a13-b1ad-949952355b7c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:00.451704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59970b-3e59-4a13-b1ad-949952355b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:00.558098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-aa59970b-3e59-4a13-b1ad-949952355b7c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:00.559319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-aa59970b-3e59-4a13-b1ad-949952355b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:00.687617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 657/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:00.728760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:00.730311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:00.855743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a62a-4dfc-4f73-b919-4123d3b502e6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:00.927636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:00.930135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:00.930741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:00.931016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:00.931285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:00.932941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:01.043680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:01.045164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bf041-2a2c-4e92-9149-7fa453d3367c service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:01.064539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 657/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:03.654041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457501e-2215-45c7-91e4-2105328d2aa5 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:03.654729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457501e-2215-45c7-91e4-2105328d2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:03.654729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457501e-2215-45c7-91e4-2105328d2aa5 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:03.655990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 658/1315] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:03.662788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b4d4-368f-43fc-88e1-65f344619ef5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:03.663380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b4d4-368f-43fc-88e1-65f344619ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:03.663380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4b4d4-368f-43fc-88e1-65f344619ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:03.738507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c8b4b4d4-368f-43fc-88e1-65f344619ef5 None None] MFA Rules not processed for user `5ed0dcb8575e454885f5e63e971ac5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:03.739743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c8b4b4d4-368f-43fc-88e1-65f344619ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:03.800725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:03.854409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 658/1316] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:03.910867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:03.911364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:03.911597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:03.913134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 659/1317] 10.222.0.36 () {54 vars in 965 bytes} [Thu Aug 4 05:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:03.919866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4ac5-f3d6-436f-a7ea-6554fdcd8eb4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:03.920186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4ac5-f3d6-436f-a7ea-6554fdcd8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:03.920462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b4ac5-f3d6-436f-a7ea-6554fdcd8eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:04.006978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3d6b4ac5-f3d6-436f-a7ea-6554fdcd8eb4 None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:04.008224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3d6b4ac5-f3d6-436f-a7ea-6554fdcd8eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:04.086362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 659/1318] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Aug 4 05:09:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:09:04.095644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:04.097226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:04.107279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:04.217118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa95c-ee6a-4416-af78-a5ac3c38ae11 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:04.296767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:04.298027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:04.298469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:04.298754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:04.300438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:04.362928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:04.410565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:04.412315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c27b0-35c7-40a0-8e49-a4a9893ad4c7 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:04.432752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 660/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:07.743655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:07.744350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:07.744350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:07.745589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 660/1320] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:07.751713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b8c1-791d-4567-9738-87de3db222dc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:07.752275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b8c1-791d-4567-9738-87de3db222dc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:07.752605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b8c1-791d-4567-9738-87de3db222dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:07.824868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8da9b8c1-791d-4567-9738-87de3db222dc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:07.826126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8da9b8c1-791d-4567-9738-87de3db222dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:07.935426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 661/1321] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:07.976898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:07.978541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:08.038869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:08.103706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3852ba-48bf-413c-8f34-206b7868729f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:08.185000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:08.185621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:08.185900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:08.186176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:08.188480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:08.304422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:08.322873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:08.325974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bd4d-8b8e-4bef-afa0-53f34acaa514 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:08.363207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 661/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:09:11.804265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:11.804848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:11.804848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:11.806108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 662/1323] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:11.811642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24156-5c6b-4da0-bd42-2af4e4f81ebe None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:11.812184 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24156-5c6b-4da0-bd42-2af4e4f81ebe None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:11.812294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24156-5c6b-4da0-bd42-2af4e4f81ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:11.884189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-49c24156-5c6b-4da0-bd42-2af4e4f81ebe None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:11.885404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-49c24156-5c6b-4da0-bd42-2af4e4f81ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:11.991607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 662/1324] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:09:12.028299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:12.029827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:12.051240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:12.148440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb2625-898a-44ef-919d-d57be4c50166 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:12.240892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:12.241489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:12.241769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:12.242043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:12.244076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:12.333093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:12.372083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:12.373991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b02dc-cdbb-4975-98b1-b341873c40b9 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:12.394092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 663/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:14.559492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:14.560100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:14.560100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:14.561549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 663/1326] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:14.569871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45b72-ba4d-465d-8c65-11b7097aa7c6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:14.570438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45b72-ba4d-465d-8c65-11b7097aa7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:14.570438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e45b72-ba4d-465d-8c65-11b7097aa7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:14.656720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-53e45b72-ba4d-465d-8c65-11b7097aa7c6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:14.657398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-53e45b72-ba4d-465d-8c65-11b7097aa7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:14.766808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 664/1327] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:14.804480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:14.806003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:14.869057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:14.915960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff795-2ed2-4b42-804c-8cfeab9e1f8e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:14.996828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:14.997445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:14.997726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:14.997998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:14.999642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:15.123000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:15.126086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:15.127744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb587e-7e76-4537-806f-8e82985e953b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:15.151395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 664/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:17.326211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:17.326743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:17.326743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:17.328378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 665/1329] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:17.333558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae297f5-3305-4cac-8330-b1ce5e8fc6ca None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:17.333980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae297f5-3305-4cac-8330-b1ce5e8fc6ca None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:17.334115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae297f5-3305-4cac-8330-b1ce5e8fc6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:17.411929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-aae297f5-3305-4cac-8330-b1ce5e8fc6ca None None] MFA Rules not processed for user `5ed0dcb8575e454885f5e63e971ac5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:17.413183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-aae297f5-3305-4cac-8330-b1ce5e8fc6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:17.519266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 665/1330] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:09:17.558699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:17.560451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:17.596167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:17.683526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183c5f8-ae36-4b8e-b70d-56f14715ec07 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:17.780247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:17.780785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:17.781067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:17.781428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:17.783176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:17.889789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:17.948198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:17.949666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5780389-eab1-4f59-adce-acf3e5f3bead service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:17.970111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 666/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:20.521408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:20.521951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:20.521951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:20.523364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 666/1332] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:20.528543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d4c88-fbee-44f1-b671-a07e10dc7b9c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:20.528960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d4c88-fbee-44f1-b671-a07e10dc7b9c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:20.529092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d4c88-fbee-44f1-b671-a07e10dc7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:20.597004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-737d4c88-fbee-44f1-b671-a07e10dc7b9c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:20.598214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-737d4c88-fbee-44f1-b671-a07e10dc7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:20.695109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 667/1333] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:20.731820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:20.733459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:20.806005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:20.843050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785a26-c894-4830-b9eb-7cd3833ebf5d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:20.922823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:20.923473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:20.923757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:20.924085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:20.925763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:21.050409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:21.051814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd41b4-b681-4ef5-b503-039ea54e8e13 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:21.061962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:21.071284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 667/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:23.152766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:23.153608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:23.153608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:23.154714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 668/1335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:09:23.160519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecdf2-43e5-4782-b6bb-f2c52c696248 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:23.161228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecdf2-43e5-4782-b6bb-f2c52c696248 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:23.161346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ecdf2-43e5-4782-b6bb-f2c52c696248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:23.227104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-737ecdf2-43e5-4782-b6bb-f2c52c696248 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:23.228353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-737ecdf2-43e5-4782-b6bb-f2c52c696248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:23.326639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 668/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:09:23.369833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:23.371378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:23.412061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:23.475887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc50c8d-3abc-48d3-8333-d8a8dec0f326 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:23.553122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:23.553746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:23.554028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:23.554301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:23.556013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:23.639303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:23.665640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:23.667015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d42db-6a62-4fe0-851c-82683c06f201 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:23.685206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 669/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:26.360220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:26.360739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:26.360924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:26.362279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 669/1338] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:26.368052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff83a0-405d-4e43-aeeb-c184e14e5734 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:26.368547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff83a0-405d-4e43-aeeb-c184e14e5734 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:26.368653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff83a0-405d-4e43-aeeb-c184e14e5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:26.434501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-22ff83a0-405d-4e43-aeeb-c184e14e5734 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:26.435724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-22ff83a0-405d-4e43-aeeb-c184e14e5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:26.534020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 670/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:26.570766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:26.572354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:26.647558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:26.674528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7861c-568d-4fa2-a9c6-bf009d635c02 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:26.747462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:26.748095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:26.748378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:26.748650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:26.751101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:26.860973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:26.862415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404ab8e-4a6e-4283-aa16-5868c1daf3e8 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:26.881264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 670/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:09:31.291153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.293074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.293074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.293921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 671/1341] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:31.301120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763279-9c4f-4f6d-a254-4ec640aecc21 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.301656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763279-9c4f-4f6d-a254-4ec640aecc21 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.301757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763279-9c4f-4f6d-a254-4ec640aecc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.307438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:31.373699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-04763279-9c4f-4f6d-a254-4ec640aecc21 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:31.375203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-04763279-9c4f-4f6d-a254-4ec640aecc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:31.479011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 671/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:31.519681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:31.521337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:31.576220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:31.641871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737f96e-5953-4928-a737-ac4c6b94f6dd None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:31.728206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:31.728834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:31.729115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:31.729386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:31.731049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:31.836208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:31.857409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:31.858850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24388d57-6a86-4bdc-8950-33dcf57209cc service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:31.879427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 672/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:35.505668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.506270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.506270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.507609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 672/1344] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:35.513476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345fa6-5d3b-4684-bfd1-1243dd2c20ea None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.514014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345fa6-5d3b-4684-bfd1-1243dd2c20ea None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.514262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345fa6-5d3b-4684-bfd1-1243dd2c20ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.595302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-de345fa6-5d3b-4684-bfd1-1243dd2c20ea None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:35.596577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-de345fa6-5d3b-4684-bfd1-1243dd2c20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:35.704567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 673/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:35.742935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:35.744641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:35.846602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:35.866810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e619fe3-cddd-4cf2-a497-e1dda4046a79 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:35.962909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:35.963446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:35.963730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:35.964047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:35.965703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:36.089574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:36.091053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690865a-176d-4da1-870b-aa451d4cf464 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:36.112611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 673/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:40.603550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:40.604125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:40.604125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:40.605522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 674/1347] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:40.611267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ffe6d-6bca-472c-a0c4-b6e72fdc746a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:40.611789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ffe6d-6bca-472c-a0c4-b6e72fdc746a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:40.611789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ffe6d-6bca-472c-a0c4-b6e72fdc746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:40.628416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:40.688363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-664ffe6d-6bca-472c-a0c4-b6e72fdc746a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:40.689765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-664ffe6d-6bca-472c-a0c4-b6e72fdc746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:40.799117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 674/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:40.840316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:40.841876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:40.914240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:40.970537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0ff82-ce87-45b8-b02b-07b176a85625 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:41.055617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:41.060048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:41.060048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:41.060048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:41.060048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:41.186376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:41.192541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:41.194587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d475911-86be-494f-aa15-665c0c7d645f service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:41.214049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 675/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:09:46.357837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2dee-cd53-43c1-9f0a-c34eac93916a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:46.358394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2dee-cd53-43c1-9f0a-c34eac93916a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:46.358394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2dee-cd53-43c1-9f0a-c34eac93916a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:46.360438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 675/1350] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:46.365923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd942e-4605-49d9-96ee-9a51ac4d70ce None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:46.366410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd942e-4605-49d9-96ee-9a51ac4d70ce None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:46.366511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd942e-4605-49d9-96ee-9a51ac4d70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:46.454607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-dcfd942e-4605-49d9-96ee-9a51ac4d70ce None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:46.455823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-dcfd942e-4605-49d9-96ee-9a51ac4d70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:46.572912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 676/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:09:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:50.796904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=59 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:50.950023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35027-26d3-4f28-b543-1d52b3c3fa55 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:50.950532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35027-26d3-4f28-b543-1d52b3c3fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:50.950906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35027-26d3-4f28-b543-1d52b3c3fa55 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:50.953275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 676/1352] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:50.959285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe8a7-b76d-4c39-8a4f-ba46fc695b4a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:50.960219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe8a7-b76d-4c39-8a4f-ba46fc695b4a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:50.960219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe8a7-b76d-4c39-8a4f-ba46fc695b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:51.022653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:51.049555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2f1fe8a7-b76d-4c39-8a4f-ba46fc695b4a None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:51.050886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2f1fe8a7-b76d-4c39-8a4f-ba46fc695b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:51.191765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 677/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:52.396335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce60ee-e734-4487-8aa3-02cec7f626d2 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.396883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce60ee-e734-4487-8aa3-02cec7f626d2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.396883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce60ee-e734-4487-8aa3-02cec7f626d2 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.398359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 677/1354] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:52.403732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0567-1f44-445e-937e-9ee1ead48dba None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:52.404243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0567-1f44-445e-937e-9ee1ead48dba None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:52.404342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0567-1f44-445e-937e-9ee1ead48dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:52.487620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f38a0567-1f44-445e-937e-9ee1ead48dba None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:52.488888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f38a0567-1f44-445e-937e-9ee1ead48dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:52.536129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:52.608318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 678/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:09:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:09:56.272375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce169df-80d5-4aa3-b69e-34972b86cce7 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.273306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce169df-80d5-4aa3-b69e-34972b86cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.273306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce169df-80d5-4aa3-b69e-34972b86cce7 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.275983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 678/1356] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:56.281077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9bfbd-944d-4a36-b940-6858b916f939 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.281980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9bfbd-944d-4a36-b940-6858b916f939 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.282413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9bfbd-944d-4a36-b940-6858b916f939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.388404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f8a9bfbd-944d-4a36-b940-6858b916f939 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:56.390777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f8a9bfbd-944d-4a36-b940-6858b916f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:56.528959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 679/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:56.585400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.585676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.586146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.587630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 679/1358] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 05:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:56.597185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a6-42ca-4f43-965a-5109621ce7ca None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:56.597562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a6-42ca-4f43-965a-5109621ce7ca None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:56.597721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a6-42ca-4f43-965a-5109621ce7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:56.620806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:56.694340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-681079a6-42ca-4f43-965a-5109621ce7ca None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:56.696157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-681079a6-42ca-4f43-965a-5109621ce7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:56.860252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 680/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:56.861250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:56.864626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:57.030941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb23e7-8214-4f08-98d9-f74d8393d98b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:09:57.118198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:57.164529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:09:57.165271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:57.165795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:57.165976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:57.167708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:57.292417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:09:57.295415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a15ad0-4c5f-4c10-a085-a849456e5a86 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:09:57.329868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 680/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:09:59.641863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:59.642419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:59.642766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:59.644450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 681/1361] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:09:59.649997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11aee4-732a-47c0-a974-8294d3ed2a90 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:09:59.650455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11aee4-732a-47c0-a974-8294d3ed2a90 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:09:59.650614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11aee4-732a-47c0-a974-8294d3ed2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:09:59.723686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ec11aee4-732a-47c0-a974-8294d3ed2a90 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:09:59.725150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ec11aee4-732a-47c0-a974-8294d3ed2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:59.767966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:09:59.840178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 681/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:09:59.884383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:09:59.887819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:09:59.970274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:00.066199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93848f71-870a-4725-bf4b-b7e167b78861 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:00.226306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:00.226971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:00.227254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:00.227605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:00.229348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:00.256476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:00.333678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:00.335217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571a0dd-f88a-494d-a02f-5abcf5002b00 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:00.356168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 682/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:02.880110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4c31-e554-4189-83f4-6b935032edee None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:02.880991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4c31-e554-4189-83f4-6b935032edee None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:02.881276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4c31-e554-4189-83f4-6b935032edee None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:02.882656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 682/1364] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:02.888768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fe4-d5ca-46b9-91a5-67295ef54401 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:02.889225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fe4-d5ca-46b9-91a5-67295ef54401 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:02.889306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fe4-d5ca-46b9-91a5-67295ef54401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:02.976461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-91f06fe4-d5ca-46b9-91a5-67295ef54401 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:02.977590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-91f06fe4-d5ca-46b9-91a5-67295ef54401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:03.090683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:03.096065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 683/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:03.144715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:03.145062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:03.145278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:03.147223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 683/1366] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 05:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:03.154463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35bad-9dfd-477d-8322-def45d07c90e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:03.154890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35bad-9dfd-477d-8322-def45d07c90e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:03.155838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced35bad-9dfd-477d-8322-def45d07c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:03.243655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ced35bad-9dfd-477d-8322-def45d07c90e None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:03.244988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ced35bad-9dfd-477d-8322-def45d07c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:03.381831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 684/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:10:03.393653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:03.395490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:03.573346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a8c7e-aeb1-4205-bb25-af3bfbc871cf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:03.596745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:03.706425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:03.707218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:03.707598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:03.708121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:03.710415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:03.816011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:03.817792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104730c5-0852-42b6-8043-e7a262449e15 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:03.839463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 684/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:04.793267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e890f-b91a-4077-bdd0-d4bae217e4e1 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:04.793902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e890f-b91a-4077-bdd0-d4bae217e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:04.793902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e890f-b91a-4077-bdd0-d4bae217e4e1 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:04.795348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 685/1369] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:04.801587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e1d-a1ba-4234-8306-84a308d71488 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:04.802081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e1d-a1ba-4234-8306-84a308d71488 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:04.802161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea3e1d-a1ba-4234-8306-84a308d71488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:04.837543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:04.876340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-58ea3e1d-a1ba-4234-8306-84a308d71488 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:04.877589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-58ea3e1d-a1ba-4234-8306-84a308d71488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:05.052024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 685/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:05.353739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:05.353739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:05.353739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:05.354860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 686/1371] 10.222.0.36 () {54 vars in 964 bytes} [Thu Aug 4 05:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:05.360248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315183-4845-49d5-b351-fbfd72664c87 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:05.360657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315183-4845-49d5-b351-fbfd72664c87 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:05.361060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315183-4845-49d5-b351-fbfd72664c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:05.450719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-40315183-4845-49d5-b351-fbfd72664c87 None None] MFA Rules not processed for user `7435f7709c1e4a59881b02d58d8c8463`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:05.452293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-40315183-4845-49d5-b351-fbfd72664c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:05.504270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:05.545214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 686/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Aug 4 05:10:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:05.546876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:05.548479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:05.607350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:05.670938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e1230-c3eb-440e-81ee-83dd14fbd2b6 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:05.755391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:05.756225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:05.756612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:05.756987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:05.758737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:05.868838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:05.883376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:05.884878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225f7d-1272-4d83-8983-b79ebafdc373 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:05.904947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 687/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:06.194454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.195194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.195194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.204555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 687/1374] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:06.205140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fe4e-95f6-4ecc-b8b5-17fde6ba5cf4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.205140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fe4e-95f6-4ecc-b8b5-17fde6ba5cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.205140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fe4e-95f6-4ecc-b8b5-17fde6ba5cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.276391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-61f1fe4e-95f6-4ecc-b8b5-17fde6ba5cf4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:06.277540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-61f1fe4e-95f6-4ecc-b8b5-17fde6ba5cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:06.388851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 688/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:06.434112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:06.435645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:06.596697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1126ca-0c6a-4384-963a-76eda0c2193f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:06.651195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:06.725695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:06.726310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:06.726588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:06.726859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:06.728513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:06.829419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:06.831077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bef65f-e267-4167-b77a-59966640f039 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:06.854407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 688/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:09.089172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.089725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.089725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.091461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 689/1377] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:09.098035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630649-2328-42ab-848c-eb8dda8a562f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.098530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630649-2328-42ab-848c-eb8dda8a562f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.098619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630649-2328-42ab-848c-eb8dda8a562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.172025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5f630649-2328-42ab-848c-eb8dda8a562f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:09.173239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5f630649-2328-42ab-848c-eb8dda8a562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:09.182753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:09.278114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 689/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:09.325293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:09.327686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:09.398169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:09.517158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de416078-69ab-41ae-8200-e9c351cb43ee None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:09.688653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:09.689284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:09.689602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:09.689918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:09.691619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:09.715851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:09.801816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:09.803452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14a48-5953-49c2-8d10-2a2c7ee46b24 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:09.823652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 690/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:12.153521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:12.154080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:12.154353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:12.156241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 690/1380] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:12.165380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ccf6-354b-4832-8671-38f4899723c7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:12.165380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ccf6-354b-4832-8671-38f4899723c7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:12.165380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ccf6-354b-4832-8671-38f4899723c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:12.241908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2680ccf6-354b-4832-8671-38f4899723c7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:12.243173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2680ccf6-354b-4832-8671-38f4899723c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:12.345498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:12.351636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 691/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:12.398992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:12.400594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:12.554675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:12.566136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d54d6f-fbd3-469b-b645-63daf92128af None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:12.709372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:12.709994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:12.710278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:12.710551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:12.712302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:12.814328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:12.815964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acb09f-577c-47ab-a3f0-a191d1c8e94f service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:12.828497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:12.837279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 691/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:15.101545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:15.102099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:15.102203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:15.104271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 692/1383] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:15.112022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2d30-9f6f-4a25-a8be-a34801d8dd4f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:15.112499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2d30-9f6f-4a25-a8be-a34801d8dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:15.112595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2d30-9f6f-4a25-a8be-a34801d8dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:15.183115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e98d2d30-9f6f-4a25-a8be-a34801d8dd4f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:15.184388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e98d2d30-9f6f-4a25-a8be-a34801d8dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:15.305131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 692/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:15.359012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:15.360549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:15.533176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c7c3-1c0e-47ba-892e-9f30da52e42d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:15.611462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:15.669101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:15.671078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:15.671078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:15.671078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:15.676583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:15.790430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:15.791995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd41f9-55ac-4494-ac3c-22c3f6f96584 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:15.810773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 693/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:17.915019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:17.915565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:17.915565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:17.917112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 693/1386] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:17.923598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c43f-b6ff-414d-b9a4-15a4348fda26 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:17.924111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c43f-b6ff-414d-b9a4-15a4348fda26 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:17.924537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c43f-b6ff-414d-b9a4-15a4348fda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:18.022733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e5f2c43f-b6ff-414d-b9a4-15a4348fda26 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:18.024737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e5f2c43f-b6ff-414d-b9a4-15a4348fda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:18.065185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:18.150381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 694/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:18.203239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:18.205853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:18.299975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:18.380486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f18947-2c4c-4169-8c57-08dffe9c3bf8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:18.513346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:18.513885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:18.514889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:18.515284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:18.517103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:18.557589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:18.618820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:18.620787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c0716-46c6-4a77-912a-5fff81db8985 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:18.643775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 694/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:20.908368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:20.908966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:20.908966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:20.910548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 695/1389] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:20.915787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bd14-08bf-4bc3-aba1-ac58eb989f8f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:20.916218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bd14-08bf-4bc3-aba1-ac58eb989f8f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:20.916406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347bd14-08bf-4bc3-aba1-ac58eb989f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:20.984151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d347bd14-08bf-4bc3-aba1-ac58eb989f8f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:20.985359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d347bd14-08bf-4bc3-aba1-ac58eb989f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.085537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 695/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:21.132081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:21.133598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.287990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583128-fa9b-45ff-a1c1-2a97d2aff1e9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:21.305677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:21.406702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:21.407347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:21.407626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:21.407934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:21.409519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.499685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:21.501450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b1636-5f6a-451b-8d6d-38ea52ee18e2 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:21.520285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 696/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:21.522929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f21-f7f0-4057-b93f-d9d4cd5cc812 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:21.523220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f21-f7f0-4057-b93f-d9d4cd5cc812 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:21.523499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f21-f7f0-4057-b93f-d9d4cd5cc812 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:21.524869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 696/1392] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:21.530853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53ced-ab0f-4c5d-83e9-73bc4568c181 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:21.531144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53ced-ab0f-4c5d-83e9-73bc4568c181 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:21.531416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53ced-ab0f-4c5d-83e9-73bc4568c181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:21.557664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:21.599273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7ac53ced-ab0f-4c5d-83e9-73bc4568c181 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:21.600512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7ac53ced-ab0f-4c5d-83e9-73bc4568c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.703050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 697/1393] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:21.762199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:21.762483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:21.762771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:21.765094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 697/1394] 10.222.0.36 () {54 vars in 966 bytes} [Thu Aug 4 05:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:21.770655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f14af-68a1-4d0b-af9c-c3ad65162ec0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:21.770942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f14af-68a1-4d0b-af9c-c3ad65162ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:21.771311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f14af-68a1-4d0b-af9c-c3ad65162ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:21.860463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ab3f14af-68a1-4d0b-af9c-c3ad65162ec0 None None] MFA Rules not processed for user `208ae4c88a3440599aad61ae876837b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:21.861706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ab3f14af-68a1-4d0b-af9c-c3ad65162ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.908294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:21.947575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 698/1395] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Aug 4 05:10:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:21.954847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:21.956419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:21.971127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:22.066230 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350ba12-df8d-4544-986b-5e0a66c196b2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:22.144731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:22.145356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:22.145641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:22.146124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:22.147727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:22.224679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:22.267319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:22.268878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8df8e2-931d-432b-b5f9-8e74a8f7f71f service glance] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:22.286954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 698/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:23.239524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14200-5699-47a2-bce7-3f4e11ab006d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.240020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14200-5699-47a2-bce7-3f4e11ab006d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.240125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14200-5699-47a2-bce7-3f4e11ab006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.307816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-edd14200-5699-47a2-bce7-3f4e11ab006d None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:23.309060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-edd14200-5699-47a2-bce7-3f4e11ab006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:23.397813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 699/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:23.441118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.441759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.441759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.443021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 699/1398] 10.222.0.36 () {54 vars in 943 bytes} [Thu Aug 4 05:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:10:23.449273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507741d3-5b57-495f-888b-327722ad0da0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.449633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507741d3-5b57-495f-888b-327722ad0da0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.449906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507741d3-5b57-495f-888b-327722ad0da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.520744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:23.528252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-507741d3-5b57-495f-888b-327722ad0da0 None None] MFA Rules not processed for user `08b0d11d73184d26987ce4bdbfe05514`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:23.529465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-507741d3-5b57-495f-888b-327722ad0da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:23.640906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 700/1399] 10.222.0.36 () {58 vars in 1040 bytes} [Thu Aug 4 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:23.650407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:23.652141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:23.731797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3ca1f-ba0b-4de0-92d9-0718092fc0cd None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.732216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3ca1f-ba0b-4de0-92d9-0718092fc0cd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.732560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3ca1f-ba0b-4de0-92d9-0718092fc0cd None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.734236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 701/1400] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:10:23.751731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.752070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.752332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.799305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277362-94d3-4653-9e09-237d69f7a974 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:23.830145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:23.831385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:23.841565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:23.898004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:23.911869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:23.912518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:23.914034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:23.914034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:23.914772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:23.937320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 702/1401] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:10:23.984503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:23.985856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:24.003769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:24.005428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e1df4-eaec-4c83-a2fa-86a31047abc3 service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:24.013687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 700/1402] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:10:24.105553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e220-b7ed-457d-ab45-0d75cfd6470f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:24.183088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:24.223058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:24.223683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:24.223996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:24.224271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:24.225915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:24.317633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:24.319242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d5ac-d723-40ce-9105-c4d1129a2812 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:24.337399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 703/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:10:26.595545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:26.596137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:26.596137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:26.597374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 701/1404] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:26.602632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196743-d415-46a7-93f3-79f01e644aba None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:26.603571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196743-d415-46a7-93f3-79f01e644aba None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:26.603946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e196743-d415-46a7-93f3-79f01e644aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:26.676626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-0e196743-d415-46a7-93f3-79f01e644aba None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:26.677854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0e196743-d415-46a7-93f3-79f01e644aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:26.723715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:26.800036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 704/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:26.837794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:26.839649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:26.919487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:27.006577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1170d-f794-4601-acac-00b413f12a7c None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:27.147589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:27.148252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:27.148531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:27.148804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:27.150470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:27.205706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:27.277009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:27.278960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745de87-e114-4725-8f91-bee4da1f7df9 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:27.301105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 702/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:10:29.667142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616950d-9143-44d2-9d60-f04727724274 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:29.667707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616950d-9143-44d2-9d60-f04727724274 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:29.667707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616950d-9143-44d2-9d60-f04727724274 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:29.669225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 705/1407] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:29.675022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4ac-7395-4363-80d4-d3ead659aeca None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:29.675471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4ac-7395-4363-80d4-d3ead659aeca None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:29.675565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c4ac-7395-4363-80d4-d3ead659aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:29.753876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1a57c4ac-7395-4363-80d4-d3ead659aeca None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:29.755099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1a57c4ac-7395-4363-80d4-d3ead659aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:29.866333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 703/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:29.917356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616950d-9143-44d2-9d60-f04727724274 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:29.918883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f616950d-9143-44d2-9d60-f04727724274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:30.086727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616950d-9143-44d2-9d60-f04727724274 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:30.110755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:30.225416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:30.225958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:30.226243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:30.226520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:30.228233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:30.348050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:30.350744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f359e91-6b39-4f27-bac7-3c57bbccb75f service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:30.410688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 706/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:39.864124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:40.393011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=88 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:48.336775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b679-6a90-4f23-b197-041386815f04 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:48.337357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b679-6a90-4f23-b197-041386815f04 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:48.337357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060b679-6a90-4f23-b197-041386815f04 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:48.338680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 704/1410] 10.222.0.36 () {54 vars in 918 bytes} [Thu Aug 4 05:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:48.344839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d48b-6bbc-4200-99cb-5d979c4db597 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:48.345306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d48b-6bbc-4200-99cb-5d979c4db597 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:48.345432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d48b-6bbc-4200-99cb-5d979c4db597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:48.423166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7ad4d48b-6bbc-4200-99cb-5d979c4db597 None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:48.424411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7ad4d48b-6bbc-4200-99cb-5d979c4db597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:48.530121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 707/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Aug 4 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:48.546221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b416-f0c1-4cc3-bdcd-01c1567e92fe None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:48.546512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b416-f0c1-4cc3-bdcd-01c1567e92fe None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:48.546813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b416-f0c1-4cc3-bdcd-01c1567e92fe None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:48.548261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 705/1412] 10.222.0.36 () {54 vars in 918 bytes} [Thu Aug 4 05:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:48.553003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87746-e22c-4057-b026-a2e80d81baea None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:48.553292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87746-e22c-4057-b026-a2e80d81baea None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:48.553591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87746-e22c-4057-b026-a2e80d81baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:48.627637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:48.630624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-80e87746-e22c-4057-b026-a2e80d81baea None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:48.631835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-80e87746-e22c-4057-b026-a2e80d81baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:48.752391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 708/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Aug 4 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:51.227996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:51.228567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:51.228567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:51.229878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:51.236185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8769-0463-4ac7-96d2-ef7626b81c33 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:51.236627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8769-0463-4ac7-96d2-ef7626b81c33 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:51.236930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8769-0463-4ac7-96d2-ef7626b81c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:51.302954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-876f8769-0463-4ac7-96d2-ef7626b81c33 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:51.304196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-876f8769-0463-4ac7-96d2-ef7626b81c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:51.359804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:51.401418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:51.445447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:51.447035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:51.597735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b530e7-a04b-4642-b367-1408516f3303 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:51.672224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:51.712693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:51.713349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:51.713633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:51.713910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:51.715536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:51.807127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:51.808754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443452-d692-405d-be93-8eb217e8cff5 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:51.827201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 707/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:10:52.762696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:52.763893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:52.763893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:52.765244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:52.770331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd701-c3f7-4fb3-94bc-9c10fa59bf4a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:52.770764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd701-c3f7-4fb3-94bc-9c10fa59bf4a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:52.770892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd701-c3f7-4fb3-94bc-9c10fa59bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:52.846946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8b4cd701-c3f7-4fb3-94bc-9c10fa59bf4a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:52.848177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8b4cd701-c3f7-4fb3-94bc-9c10fa59bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:52.874840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:52.944717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:53.096136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:53.097646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:53.244465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654a38-7c62-488d-ad4f-c3155b087661 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:53.285674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:53.359252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:53.359862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:53.360171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:53.360442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:53.362054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:53.450163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:53.451943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315557-d52d-40be-8ff9-d25abe13bf7e service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:53.470173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 711/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:54.359225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190079ae-9470-4046-b770-2be11a015728 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:54.359774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190079ae-9470-4046-b770-2be11a015728 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:54.359774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190079ae-9470-4046-b770-2be11a015728 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:54.361167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 05:10:54.366167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33f56-d3bd-449b-9877-7967ea98694c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:54.366628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33f56-d3bd-449b-9877-7967ea98694c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:54.366729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33f56-d3bd-449b-9877-7967ea98694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:54.423311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:54.444572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d8f33f56-d3bd-449b-9877-7967ea98694c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:54.445797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d8f33f56-d3bd-449b-9877-7967ea98694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:54.543824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:54.696114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190079ae-9470-4046-b770-2be11a015728 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:54.697729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-190079ae-9470-4046-b770-2be11a015728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:54.845322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190079ae-9470-4046-b770-2be11a015728 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:54.857677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:54.961708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:54.962232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:54.962512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:54.962868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:54.964540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:55.054426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:55.056203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db2031-8f6b-43fd-875a-97f37ec4a35a service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:55.074845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 710/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:55.945527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:55.946053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:55.946053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:55.947421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:55.953221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfda5-2fdf-49b1-aff2-0863c62a17f5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:55.953642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfda5-2fdf-49b1-aff2-0863c62a17f5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:55.953777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfda5-2fdf-49b1-aff2-0863c62a17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:55.973815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:56.030167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-67ebfda5-2fdf-49b1-aff2-0863c62a17f5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:56.031389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-67ebfda5-2fdf-49b1-aff2-0863c62a17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:56.137767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:10:56.292313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:56.294010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:56.405471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:56.442852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33146814-8c5f-4f85-8e94-f0f7fff8f6e3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:56.555777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:56.556335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:56.556613 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:56.556880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:56.558477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:56.635175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:56.649377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:56.655070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac80228-cab4-4cf8-b4de-94445a4fb72e service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:56.669447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 714/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:57.548225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:57.548791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:57.548791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:57.550089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:57.554970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f2816-231a-4252-b97d-b7bf8f8147b8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:57.555427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f2816-231a-4252-b97d-b7bf8f8147b8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:57.555536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f2816-231a-4252-b97d-b7bf8f8147b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:57.633555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-310f2816-231a-4252-b97d-b7bf8f8147b8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:57.634773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-310f2816-231a-4252-b97d-b7bf8f8147b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:57.733688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:57.884150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:57.885746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:57.969831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:58.031817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64a4a-34bd-4f32-9f36-a5f9371e2f5d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:58.150491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:58.151035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:58.151316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:58.151590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:58.153476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:58.204529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:58.248382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:58.250023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98b208-fec9-4aca-a38f-875b3c85fca3 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:58.268221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 713/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:10:59.151534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:59.152168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:59.152168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:59.153683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:10:59.159432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8089c-250f-4f1c-8c39-22d7432ec477 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:59.159958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8089c-250f-4f1c-8c39-22d7432ec477 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:59.160060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8089c-250f-4f1c-8c39-22d7432ec477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:59.240330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c4c8089c-250f-4f1c-8c39-22d7432ec477 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:10:59.241561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c4c8089c-250f-4f1c-8c39-22d7432ec477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:59.339260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:10:59.493890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:10:59.495312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:59.547021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:59.645260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d9ce6-5207-460b-853c-3fa599a9b61f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:10:59.760553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:10:59.761105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:10:59.761389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:10:59.761663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:10:59.763964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:10:59.771418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:10:59.858369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:10:59.860001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355b4ad-a44e-4c7e-94a8-49446a2e3194 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:10:59.878854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 717/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:00.744414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:00.744924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:00.745062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:00.746310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:00.751323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb504-1459-4a7c-82fe-d0b328ef7639 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:00.751767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb504-1459-4a7c-82fe-d0b328ef7639 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:00.751921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb504-1459-4a7c-82fe-d0b328ef7639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:00.951642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a86bb504-1459-4a7c-82fe-d0b328ef7639 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:00.953661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a86bb504-1459-4a7c-82fe-d0b328ef7639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:01.022746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:01.051264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:01.206152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:01.207601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:01.226197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:01.355088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38ee6-61a0-4f56-a274-06e49ac94c13 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:01.442684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:01.468925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:01.469449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:01.469729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:01.470008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:01.471650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:01.561292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:01.563186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ce7d-f924-4095-bd5b-f73ea7388856 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:01.581576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 716/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:02.448128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:02.448696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:02.448696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:02.449939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:02.454974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34805b2-1b6e-49ea-a357-eaf504e02de5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:02.455402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34805b2-1b6e-49ea-a357-eaf504e02de5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:02.455516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34805b2-1b6e-49ea-a357-eaf504e02de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:02.531822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f34805b2-1b6e-49ea-a357-eaf504e02de5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:02.533044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f34805b2-1b6e-49ea-a357-eaf504e02de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:02.574444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:02.629619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:02.782875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:02.784693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:02.931441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bab46e-2970-4c1d-bc73-04bc7ea89fce None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:02.986718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:03.045126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:03.045761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:03.046153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:03.046427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:03.048060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:03.140201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:03.141962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4ea01-127e-4ddd-a4c9-cf20946268a1 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:03.163874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 720/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:04.041905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:04.042444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:04.042444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:04.043724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:04.049472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8acc1c-ceda-4471-9b03-b462be0b1379 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:04.049887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8acc1c-ceda-4471-9b03-b462be0b1379 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:04.050017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8acc1c-ceda-4471-9b03-b462be0b1379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:04.128747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-fb8acc1c-ceda-4471-9b03-b462be0b1379 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:04.130043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fb8acc1c-ceda-4471-9b03-b462be0b1379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:04.132086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:04.236789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:04.395431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:04.397019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:04.544004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcba-ba70-4df9-9750-d85394e47e94 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:04.572824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:04.658395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:04.658928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:04.659461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:04.659732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:04.661518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:04.752648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:04.754246 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b5790-a12b-4615-b100-7b464979b711 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:04.772054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 719/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:06.694024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:06.694608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:06.694608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:06.696304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:06.701673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795507f-f406-42a5-8a2b-b3ba88599b24 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:06.702058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795507f-f406-42a5-8a2b-b3ba88599b24 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:06.702058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795507f-f406-42a5-8a2b-b3ba88599b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:06.743515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:06.769211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b795507f-f406-42a5-8a2b-b3ba88599b24 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:06.770471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b795507f-f406-42a5-8a2b-b3ba88599b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:06.869090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:06.909747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:06.911311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:07.015191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90721317-ba1a-4c42-b032-4267518ed902 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:07.048201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:07.091264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:07.091880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:07.092187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:07.092457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:07.094059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:07.205417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:07.206847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb953c-72d3-4413-876e-0d70c4f28233 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:07.225734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 723/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:09.412336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:09.412880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:09.412880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:09.414277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:09.419504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e3d2-e7a2-44ac-af14-ae7b914e1f6d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:09.419928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e3d2-e7a2-44ac-af14-ae7b914e1f6d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:09.420102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5e3d2-e7a2-44ac-af14-ae7b914e1f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:09.485491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e7c5e3d2-e7a2-44ac-af14-ae7b914e1f6d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:09.487372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e7c5e3d2-e7a2-44ac-af14-ae7b914e1f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:09.499974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:09.586174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:11:09.624829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:09.627072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:09.731003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632bf7-e639-4a3f-b186-14d2c39e6d0d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:09.743660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:09.805443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:09.806052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:09.806330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:09.806600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:09.808265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:09.917850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:09.919291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ada9a-9c0a-458d-950b-985dc1e4334e service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:09.937807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 722/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:12.431478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:12.432055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:12.432055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:12.433453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:12.439153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816949b-299f-4069-be45-17f25d776b96 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:12.439635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816949b-299f-4069-be45-17f25d776b96 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:12.439810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816949b-299f-4069-be45-17f25d776b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:12.488169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:12.506037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-9816949b-299f-4069-be45-17f25d776b96 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:12.507298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9816949b-299f-4069-be45-17f25d776b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:12.604529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:12.644257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:12.645861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:12.750765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d9c0-53b0-4f41-aa69-830ab4717c2e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:12.790875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:12.825901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283644d-c772-443f-a777-6329da05849a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:12.826518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644d-c772-443f-a777-6329da05849a service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:12.826801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644d-c772-443f-a777-6329da05849a service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:12.827077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644d-c772-443f-a777-6329da05849a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:12.828873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b283644d-c772-443f-a777-6329da05849a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:12.938810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283644d-c772-443f-a777-6329da05849a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:12.940483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283644d-c772-443f-a777-6329da05849a service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:12.958341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 726/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:15.113513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:15.114062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:15.114062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:15.115428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:15.120895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fea61-0a58-43a1-8646-dc281db28da2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:15.121345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fea61-0a58-43a1-8646-dc281db28da2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:15.121514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fea61-0a58-43a1-8646-dc281db28da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:15.188996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bb8fea61-0a58-43a1-8646-dc281db28da2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:15.190210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bb8fea61-0a58-43a1-8646-dc281db28da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:15.210755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:15.287502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:15.327440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:15.329058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:15.432235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e007b39-2121-4380-aa8e-e8b971a6b724 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:15.452388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:15.505777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:15.506399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:15.506677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:15.506949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:15.508628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:15.618504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:15.619953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560387c-eec3-4925-99e8-5ab560deb54f service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:15.638342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 725/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:17.714295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:17.714771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:17.714891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:17.716245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:17.722010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710eaf-02a4-40d5-b24b-05865b9a26a1 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:17.722450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710eaf-02a4-40d5-b24b-05865b9a26a1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:17.722581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710eaf-02a4-40d5-b24b-05865b9a26a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:17.789221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:17.791943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-91710eaf-02a4-40d5-b24b-05865b9a26a1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:17.793197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-91710eaf-02a4-40d5-b24b-05865b9a26a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:17.888386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:17.927846 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:17.929424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:18.034269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563107cc-ebb4-439d-8c56-ec9c59e580a9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:18.089737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:18.114861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:18.115472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:18.115746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:18.116043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:18.117688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:18.227345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:18.228816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9172-001f-411a-a095-45e27bdf4216 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:18.247619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 729/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:20.451242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:20.451784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:20.451784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:20.453193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:20.458616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3c7e-79ad-4aed-b2cd-e3a73b5b29fa None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:20.459025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3c7e-79ad-4aed-b2cd-e3a73b5b29fa None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:20.459152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc3c7e-79ad-4aed-b2cd-e3a73b5b29fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:20.527474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-89bc3c7e-79ad-4aed-b2cd-e3a73b5b29fa None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:20.528716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-89bc3c7e-79ad-4aed-b2cd-e3a73b5b29fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:20.558467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:20.626020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:20.664145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:20.665792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:20.769882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee23d59-f6e4-423d-86d3-833770fad317 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:20.798919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:20.844104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:20.845402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:20.845683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:20.845956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:20.847578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:20.958360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:20.959777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe5496-514a-4b42-9964-b9b9abb7af12 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:20.978726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 728/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:23.055492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:23.056070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:23.056070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:23.057341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:23.062800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330704-9afd-4eb7-986e-215391f2440b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:23.063299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330704-9afd-4eb7-986e-215391f2440b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:23.064063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8330704-9afd-4eb7-986e-215391f2440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:23.132439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b8330704-9afd-4eb7-986e-215391f2440b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:23.133730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b8330704-9afd-4eb7-986e-215391f2440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:23.142265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:23.232291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:23.270773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:23.272416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:23.378683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79a11-1360-466f-aa87-d2300fd19e05 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:23.436594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:23.455420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:23.456068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:23.456352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:23.456624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:23.458255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:23.568020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:23.569461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3584c96-f216-4d6f-95ae-53c8d0a13635 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:23.588408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 732/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:25.649996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:25.650563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:25.650563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:25.651895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:25.657481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213a0d-f21e-42b9-9eac-44f7c40ea2db None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:25.657925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213a0d-f21e-42b9-9eac-44f7c40ea2db None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:25.658038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff213a0d-f21e-42b9-9eac-44f7c40ea2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:25.724065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ff213a0d-f21e-42b9-9eac-44f7c40ea2db None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:25.725278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ff213a0d-f21e-42b9-9eac-44f7c40ea2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:25.764936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:25.823593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:25.862847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:25.864479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:25.969077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277108f-f040-4e26-8be7-81440b8efd7a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:26.008126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:26.044755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:26.045377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:26.045676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:26.045949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:26.048540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:26.156775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:26.158255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab919b6-d945-4efe-8ca1-a2dd9cfbaa2f service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:26.178573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 731/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:28.223504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:28.224129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:28.224129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:28.225441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:28.230737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a815f-183a-40ef-824d-9c441269b461 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:28.231172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a815f-183a-40ef-824d-9c441269b461 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:28.231288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a815f-183a-40ef-824d-9c441269b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:28.298268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1f2a815f-183a-40ef-824d-9c441269b461 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:28.299405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1f2a815f-183a-40ef-824d-9c441269b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:28.317417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:28.397656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:28.435499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:28.437080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:28.542390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dd29b-de77-4093-8aa5-8096056fb71c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:28.611176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:28.617976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:28.622330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:28.622330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:28.622330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:28.622330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:28.731087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:28.732582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97c5bc-6b3d-4ec2-898a-e6d42d7c1001 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:28.751516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 735/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:30.751460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883211-9d25-424c-817a-45210e8725bf None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:30.752037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883211-9d25-424c-817a-45210e8725bf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:30.752037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea883211-9d25-424c-817a-45210e8725bf None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:30.753419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:30.758515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3a2f-37a6-4238-85a4-7af26db58704 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:30.758965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3a2f-37a6-4238-85a4-7af26db58704 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:30.759077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3a2f-37a6-4238-85a4-7af26db58704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:30.826141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-3eeb3a2f-37a6-4238-85a4-7af26db58704 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:30.827379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3eeb3a2f-37a6-4238-85a4-7af26db58704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:30.876622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:30.926560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:30.963786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea883211-9d25-424c-817a-45210e8725bf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:30.965417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ea883211-9d25-424c-817a-45210e8725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:31.191708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea883211-9d25-424c-817a-45210e8725bf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:31.238932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:31.264804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:31.265408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:31.265684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:31.265956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:31.268129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:31.379061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:31.380524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94ba58-f001-4b5e-a6ac-d689b013e6ef service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:31.398356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 734/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:40.924670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=22 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:41.396066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=66 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:51.116215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03a08-7b53-451d-9e3d-02ccc9ac703e None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:51.116743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03a08-7b53-451d-9e3d-02ccc9ac703e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:51.116743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03a08-7b53-451d-9e3d-02ccc9ac703e None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:51.118128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 737/1471] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:51.123517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3fcb-3a9e-4512-bcf1-575cfbdbd5a7 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:51.123985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3fcb-3a9e-4512-bcf1-575cfbdbd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:51.124127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3fcb-3a9e-4512-bcf1-575cfbdbd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:51.193863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ed6a3fcb-3a9e-4512-bcf1-575cfbdbd5a7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:51.195090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ed6a3fcb-3a9e-4512-bcf1-575cfbdbd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:51.294512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 735/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:51.378884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:51.379202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:51.379486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:51.380896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 738/1473] 10.222.0.36 () {54 vars in 966 bytes} [Thu Aug 4 05:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:51.385756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ada9-573c-41a4-a1fa-0a9c376e8848 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:51.386047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ada9-573c-41a4-a1fa-0a9c376e8848 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:51.386326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ada9-573c-41a4-a1fa-0a9c376e8848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:51.462569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-de93ada9-573c-41a4-a1fa-0a9c376e8848 None None] MFA Rules not processed for user `208ae4c88a3440599aad61ae876837b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:51.463788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-de93ada9-573c-41a4-a1fa-0a9c376e8848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:51.485614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:51.541741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 736/1474] 10.222.0.36 () {58 vars in 1063 bytes} [Thu Aug 4 05:11:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:51.549873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:51.551420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:51.658780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33974dbd-514c-43b4-9aeb-227749d7c6c5 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:51.735122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:51.735746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:51.736095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:51.736370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:51.738003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:51.793254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:51.850231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:51.851702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04142fd-184d-46d0-aaca-40ea9f684094 service glance] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:51.870628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 739/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:53.969272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:53.969981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:53.969981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:53.971130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 737/1476] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:53.976342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0e21-d882-4871-9c2f-d7e844a120a2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:53.976806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0e21-d882-4871-9c2f-d7e844a120a2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:53.976918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0e21-d882-4871-9c2f-d7e844a120a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:54.042457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e2ed0e21-d882-4871-9c2f-d7e844a120a2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:54.043682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2ed0e21-d882-4871-9c2f-d7e844a120a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:54.143061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 740/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:54.166753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:54.168327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:54.294869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02b24-d1a2-4173-a6b3-e2f2ea20c5da None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:54.344375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:54.388769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:54.389382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:54.389664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:54.389939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:54.391342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:54.393245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:11:54.393245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:11:54.393245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:11:54.394384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87b956-ba17-44bc-be52-a6487504db47 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:54.413237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 738/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Aug 4 05:11:54 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:11:56.430584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:56.431163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:56.431298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:56.432744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 741/1479] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:56.438421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851c00-d882-4fd3-aa50-b92d41e2f27e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:56.438883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851c00-d882-4fd3-aa50-b92d41e2f27e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:56.438991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851c00-d882-4fd3-aa50-b92d41e2f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:56.506064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-80851c00-d882-4fd3-aa50-b92d41e2f27e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:56.507277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-80851c00-d882-4fd3-aa50-b92d41e2f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:56.604812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 739/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:56.649125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:56.650654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:56.661504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:56.804005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa80247-2cb7-4d70-913e-b7fb9bad87aa None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:56.886743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:56.919893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:56.920542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:56.920824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:56.921100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:56.923309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:57.013842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:57.015560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a097c-2373-4758-99f7-fda65c19cfb5 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:57.034580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 742/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:11:59.258777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:59.259378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:59.259378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:59.260709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 740/1482] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:11:59.266711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c900-f0c7-4dde-9f5d-0cd5a508fd5f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:59.267261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c900-f0c7-4dde-9f5d-0cd5a508fd5f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:59.267364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c900-f0c7-4dde-9f5d-0cd5a508fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:59.334245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a214c900-f0c7-4dde-9f5d-0cd5a508fd5f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:11:59.335466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a214c900-f0c7-4dde-9f5d-0cd5a508fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:59.382467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:59.433618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 743/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:11:59.470279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:11:59.471842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:59.496026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:59.574018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82437-84f2-4e6b-984b-c8ea354ca9c8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:11:59.645234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:11:59.645790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:11:59.646063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:11:59.646335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:11:59.647960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:11:59.722266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:11:59.757218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:11:59.758814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47b3e5-600d-493e-bd16-3d9c82162d64 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:11:59.777575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 741/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:12:01.821516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:01.822074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:01.822074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:01.823434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 744/1485] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:12:01.830017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea518-79dd-42d9-988f-b84904a6874a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:01.830439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea518-79dd-42d9-988f-b84904a6874a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:01.830583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea518-79dd-42d9-988f-b84904a6874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:01.897982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c2fea518-79dd-42d9-988f-b84904a6874a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:12:01.898901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c2fea518-79dd-42d9-988f-b84904a6874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:01.996095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 742/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:12:02.034207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:12:02.035771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:02.141785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade391b-8e6d-4e32-b938-b059e69dc1d3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:12:02.217653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:02.219744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:12:02.220428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:02.220725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:02.220996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:02.222649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:02.333243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:12:02.334632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67485c0d-9aa6-4efa-bc61-a90b49fd5768 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:12:02.353634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 745/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:12:04.479673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:04.480302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:04.480302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:04.481644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 743/1488] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:12:04.486895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d75e-9df5-45ce-b27b-0a3aa55a739c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:04.487336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d75e-9df5-45ce-b27b-0a3aa55a739c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:04.487436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d75e-9df5-45ce-b27b-0a3aa55a739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:04.553180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c1f4d75e-9df5-45ce-b27b-0a3aa55a739c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:12:04.554386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c1f4d75e-9df5-45ce-b27b-0a3aa55a739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:04.607457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:04.650656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 746/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:12:04.692649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:12:04.694219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:04.732806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:04.802341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6731d2-8c60-4569-b07f-bbc45c997b20 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:12:04.876472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:12:04.883610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:04.883610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:04.883610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:04.883610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:04.963687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:04.994714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:12:04.996116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d8cf-5e7b-497b-a821-2d43c5e6f46e service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:12:05.014855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 744/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:12:07.605340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:07.605913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:07.605913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:07.607321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 747/1491] 10.222.0.36 () {54 vars in 927 bytes} [Thu Aug 4 05:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:12:07.612767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f2ea-a8ae-454f-8d90-62c94107bc68 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:07.613195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f2ea-a8ae-454f-8d90-62c94107bc68 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:07.613331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f2ea-a8ae-454f-8d90-62c94107bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:07.679889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b7e1f2ea-a8ae-454f-8d90-62c94107bc68 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:12:07.681135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b7e1f2ea-a8ae-454f-8d90-62c94107bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:07.783287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 745/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Aug 4 05:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:12:07.822985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:12:07.824543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:07.931665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c92d-5e1b-4c0d-9eb7-c0624311f55d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:12:08.006035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:12:08.006656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:12:08.006937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:12:08.007214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:12:08.008928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:12:08.019973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:08.126878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:12:08.128697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee514c8-d30c-49dd-a079-f19399824dce service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:12:08.148069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 748/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:12:17.780618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=82 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:12:18.145666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=50 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:51.624290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:51.624901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:51.624901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:51.702922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:13:51.704311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:51.799419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 746/1494] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:13:51.807935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:51.808483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:51.808483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:51.886094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:13:51.887222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:51.988625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 749/1495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:13:51.993485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:51.994696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:52.006612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc146b-beba-415c-90f6-598e2c7f164d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:52.068879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:52.103743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:52.104386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:52.104667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:52.104940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:52.105628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:13:52.105933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:52.107113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:52.107113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:13:52.107113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:13:52.108025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:52.119403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 747/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:13:52.127927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:52.138422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d37f-d611-4393-b543-b2a8ad5eddec None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:52.201301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:52.235363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:52.236015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:52.236302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:52.236578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:52.237252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:52.239032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:52.239032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:13:52.239032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:13:52.240264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:52.368848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 750/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:13:52 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:13:52.373099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:52.374628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:52.409000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f3b50-b3de-4b9c-8d47-8a36afa74c99 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:52.502046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:52.502706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:52.502989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:52.503266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:52.503947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:52.504962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:52.504962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:13:52.504962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:13:52.506168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:52.619238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 748/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:13:52 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:13:52.623427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:52.625021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:52.689559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef825-88eb-4295-b6d7-0953166ddc5d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:52.776751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:52.787066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:52.790561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:52.790561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:52.790561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:52.790561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:52.791104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:52.791104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:13:52.791104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:13:52.792022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:52.805080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 751/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:13:52.809179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:52.810709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:52.823142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8fac8-b5f2-4e4c-aef1-1cc61e6f34c2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:52.848944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:52.920421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:52.921037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:52.921316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:52.921589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:52.922288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:52.923322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:52.923322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:13:52.923322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:13:52.924237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7030893-2ed7-4719-8e40-a9740b685767 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:52.936628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 749/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:13:52.940935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:52.942448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:52.978410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bb2fc-bd22-4c7c-8d39-8f00d2a01dd6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:53.073119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:53.073833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.074115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.074394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] PATH_INFO: `/v3/projects/7609f8f350424d3faa874f56c64fed5e/users/55ed007d5d044c45b782fd2c6d28db25/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.096515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7609f8f350424d3faa874f56c64fed5e, user_id=55ed007d5d044c45b782fd2c6d28db25, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:53.097629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:53.097629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:13:53.097629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:13:53.099617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a8a20-eddc-4643-b072-abebf35376df admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:53.204264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 752/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:13:52 2022] PUT /identity/v3/projects/7609f8f350424d3faa874f56c64fed5e/users/55ed007d5d044c45b782fd2c6d28db25/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:13:53.219390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb96af-969d-49d0-b98f-00672479528f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.219678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb96af-969d-49d0-b98f-00672479528f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.220011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb96af-969d-49d0-b98f-00672479528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.278520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1feb96af-969d-49d0-b98f-00672479528f None None] MFA Rules not processed for user `55ed007d5d044c45b782fd2c6d28db25`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:13:53.279754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1feb96af-969d-49d0-b98f-00672479528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:53.359021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 750/1502] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:13:53.372553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.372843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.373124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.374486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 753/1503] 10.222.0.36 () {54 vars in 964 bytes} [Thu Aug 4 05:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:13:53.379241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc124-1445-465c-b3fc-28418a3427b8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.379527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc124-1445-465c-b3fc-28418a3427b8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.379812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbc124-1445-465c-b3fc-28418a3427b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.411773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:53.455750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7fbbc124-1445-465c-b3fc-28418a3427b8 None None] MFA Rules not processed for user `7435f7709c1e4a59881b02d58d8c8463`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:13:53.456975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7fbbc124-1445-465c-b3fc-28418a3427b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:53.534301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 751/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Aug 4 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:13:53.542269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:53.543798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:53.594546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:53.648111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83fae6-8bd0-44a6-a5b6-6cb9c207ac36 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:53.727049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:53.727587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.727865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.728194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.729804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:53.831931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:53.833444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:53.842554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:53.857531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 754/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:13:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:13:53.904467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1110b-5dd2-4a47-898d-722268402fa5 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:53.904907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1110b-5dd2-4a47-898d-722268402fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:53.905004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1110b-5dd2-4a47-898d-722268402fa5 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:53.906541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 752/1506] 10.222.0.36 () {52 vars in 830 bytes} [Thu Aug 4 05:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:13:53.910267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:53.917891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:54.011938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c445fa-bae4-4979-8ed8-73e56e33453c service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:54.107699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:54.108396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:54.108677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:54.108947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] PATH_INFO: `/v3/users/55ed007d5d044c45b782fd2c6d28db25` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:54.122328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ed007d5d044c45b782fd2c6d28db25)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:54.123426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:54.123426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:13:54.123426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:13:54.124901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:54.135925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:54.346193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ed007d5d044c45b782fd2c6d28db25'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:54.360622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ed007d5d044c45b782fd2c6d28db25'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:54.361077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ed007d5d044c45b782fd2c6d28db25'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:54.383970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ed007d5d044c45b782fd2c6d28db25'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:54.475344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ed007d5d044c45b782fd2c6d28db25'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:54.481910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 755/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:13:53 2022] DELETE /identity/v3/users/55ed007d5d044c45b782fd2c6d28db25 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:13:54.486498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:54.486789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:54.489462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:54.543278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:13:54.544507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:54.618335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:54.630161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 753/1508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:13:54.641429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:54.642691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:54.744262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2862-b794-4848-a69a-b1438f2309b7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:54.801244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:13:54.821596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:54.822435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:54.822718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:54.822995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:54.824723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:54.937325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:54.938692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7082fcc-b523-44d3-8e7a-0df49bc2a4da service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:54.958068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 756/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:13:55.477181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:13:55.478449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:13:55.490141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641cb9f-7ef0-460d-bd17-fa5ebf14e04e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:13:55.591502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:13:55.592165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:13:55.592444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:13:55.592714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] PATH_INFO: `/v3/projects/7609f8f350424d3faa874f56c64fed5e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:13:55.603554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7609f8f350424d3faa874f56c64fed5e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:13:55.604644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:13:55.604644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:13:55.604644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:13:55.605884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:13:55.739029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7609f8f350424d3faa874f56c64fed5e', 'request_id': 'req-09c31f8f-0e50-4cae-a118-0e876699f292'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:55.752485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7609f8f350424d3faa874f56c64fed5e', 'request_id': 'req-09c31f8f-0e50-4cae-a118-0e876699f292'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:55.823435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7609f8f350424d3faa874f56c64fed5e', 'request_id': 'req-09c31f8f-0e50-4cae-a118-0e876699f292'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:55.847551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] The token cache is being invalidate because project 7609f8f350424d3faa874f56c64fed5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:13:55.847839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:55.848297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-09c31f8f-0e50-4cae-a118-0e876699f292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:13:55.849729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 754/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:13:55 2022] DELETE /identity/v3/projects/7609f8f350424d3faa874f56c64fed5e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:14:04.955728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=62 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:05.845395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:29.454040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:29.454649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:29.454649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:29.455995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:29.461043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf74b2-9e1a-4ccf-ab61-2365cd391e94 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:29.461462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf74b2-9e1a-4ccf-ab61-2365cd391e94 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:29.461599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf74b2-9e1a-4ccf-ab61-2365cd391e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:29.542781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4ddf74b2-9e1a-4ccf-ab61-2365cd391e94 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:29.544039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4ddf74b2-9e1a-4ccf-ab61-2365cd391e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:29.645708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:29.800386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:29.802789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:29.925045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c499-b66d-4f23-8828-3d949bc68260 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:29.930662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:29.931285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:29.931573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:29.931957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:29.940523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:29.942161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41efcc-6abf-4686-9f98-adb4c1061f31 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:29.952883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 758/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:30.799535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee4fb-b277-4a17-8885-45163729830a None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:30.800115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee4fb-b277-4a17-8885-45163729830a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:30.800115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee4fb-b277-4a17-8885-45163729830a None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:30.801472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:30.806911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66361-40be-4a82-ba1e-ce0ae0bda6d0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:30.807360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66361-40be-4a82-ba1e-ce0ae0bda6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:30.807473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66361-40be-4a82-ba1e-ce0ae0bda6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:30.828096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5bd66361-40be-4a82-ba1e-ce0ae0bda6d0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:30.829304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5bd66361-40be-4a82-ba1e-ce0ae0bda6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:30.837931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:30.993459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee4fb-b277-4a17-8885-45163729830a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:31.008151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee4fb-b277-4a17-8885-45163729830a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:31.013914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:31.014549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:31.014829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:31.015105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:31.024030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:31.028047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8f46-c130-4ab0-8994-e500c7199f56 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:31.035462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 757/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:33.126894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8be0-1f0b-47fa-9209-2cbdb9b454ef None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:33.127468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8be0-1f0b-47fa-9209-2cbdb9b454ef None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:33.127468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8be0-1f0b-47fa-9209-2cbdb9b454ef None None] PATH_INFO: `/v3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:33.128773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 760/1517] 10.222.0.58 () {54 vars in 925 bytes} [Thu Aug 4 05:15:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:15:33.140403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d29b7-1fe5-4e3c-8310-a5226b94244c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:33.140824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d29b7-1fe5-4e3c-8310-a5226b94244c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:33.140958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d29b7-1fe5-4e3c-8310-a5226b94244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:33.201656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-053d29b7-1fe5-4e3c-8310-a5226b94244c None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:33.202890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-053d29b7-1fe5-4e3c-8310-a5226b94244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:33.220062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:33.277953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 758/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Aug 4 05:15:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:40.823081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=56 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:42.286677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb928-06f4-450e-8a98-a7ecdd8ee8e0 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:42.287340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb928-06f4-450e-8a98-a7ecdd8ee8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:42.287340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb928-06f4-450e-8a98-a7ecdd8ee8e0 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:42.288635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 761/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:42.294279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f1-8019-4ea7-b5f8-d8cf5948444f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:42.294772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f1-8019-4ea7-b5f8-d8cf5948444f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:42.294887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f1-8019-4ea7-b5f8-d8cf5948444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:42.314745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b41784f1-8019-4ea7-b5f8-d8cf5948444f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:42.316113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b41784f1-8019-4ea7-b5f8-d8cf5948444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:42.324801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 759/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:42.479232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb928-06f4-450e-8a98-a7ecdd8ee8e0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:42.493782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb928-06f4-450e-8a98-a7ecdd8ee8e0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:42.499461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:42.500108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:42.500392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:42.500668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:42.509887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:42.511491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bfce-e59a-4d90-affc-de5268cbae9a service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:42.521589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 762/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:43.351717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46fc2-f03a-41eb-82f2-426271f0d8ac None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:43.352302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46fc2-f03a-41eb-82f2-426271f0d8ac None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:43.352302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f46fc2-f03a-41eb-82f2-426271f0d8ac None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:43.353569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:43.358710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a835fe-cbd2-4997-b1e0-15775d1f7c0c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:43.359192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a835fe-cbd2-4997-b1e0-15775d1f7c0c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:43.359296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a835fe-cbd2-4997-b1e0-15775d1f7c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:43.378603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a6a835fe-cbd2-4997-b1e0-15775d1f7c0c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:43.379809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a6a835fe-cbd2-4997-b1e0-15775d1f7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:43.388540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:43.542669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f46fc2-f03a-41eb-82f2-426271f0d8ac None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:43.558104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f46fc2-f03a-41eb-82f2-426271f0d8ac None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:43.563750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:43.565972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:43.565972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:43.565972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:43.573974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:43.575559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7bd00-1a70-43c0-bcc8-76bb0e9370c2 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:43.585387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 761/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:44.807790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf8a1-d1db-420c-a821-392763ccb088 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:44.808366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf8a1-d1db-420c-a821-392763ccb088 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:44.808366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf8a1-d1db-420c-a821-392763ccb088 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:44.809657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 764/1525] 10.222.0.36 () {54 vars in 961 bytes} [Thu Aug 4 05:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:44.814686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d44a9-16be-4192-a612-e0c9d2f2cf4c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:44.815142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d44a9-16be-4192-a612-e0c9d2f2cf4c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:44.815254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d44a9-16be-4192-a612-e0c9d2f2cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:44.835129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-a75d44a9-16be-4192-a612-e0c9d2f2cf4c None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:44.836406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a75d44a9-16be-4192-a612-e0c9d2f2cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:44.845692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 762/1526] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Aug 4 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:44.854475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf8a1-d1db-420c-a821-392763ccb088 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:44.868395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf8a1-d1db-420c-a821-392763ccb088 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:44.874311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:44.874936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:44.875217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:44.875492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:44.885309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:44.886916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b4a88-1d7c-4817-800a-a98deb3f7550 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:44.897342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 765/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:54.830231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=35 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:54.879853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa49bc-583d-41c2-9083-127b0f35a197 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:54.880174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa49bc-583d-41c2-9083-127b0f35a197 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:54.880459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa49bc-583d-41c2-9083-127b0f35a197 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:54.881823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:54.887603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b952-aecd-41b3-8669-4b45513c2d82 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:54.888181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b952-aecd-41b3-8669-4b45513c2d82 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:54.888181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b952-aecd-41b3-8669-4b45513c2d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:54.893354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=15 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:54.910205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-90b2b952-aecd-41b3-8669-4b45513c2d82 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:54.911513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-90b2b952-aecd-41b3-8669-4b45513c2d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:54.920193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:55.078654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa49bc-583d-41c2-9083-127b0f35a197 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:55.093915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa49bc-583d-41c2-9083-127b0f35a197 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:55.099428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:55.100071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:55.100349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:55.100618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:55.110424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:55.112103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c89037-53b6-412d-be04-5ef6d06a9315 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:55.123087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 764/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:15:55.960524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93b88-ba96-4dbf-a2ef-b95537f308ca None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:55.961059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93b88-ba96-4dbf-a2ef-b95537f308ca None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:55.961059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca93b88-ba96-4dbf-a2ef-b95537f308ca None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:55.962678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 05:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:15:55.968292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb38f6-5d29-4c31-b605-2056ce2395fc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:55.968821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb38f6-5d29-4c31-b605-2056ce2395fc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:55.969225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb38f6-5d29-4c31-b605-2056ce2395fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:55.988858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b2bb38f6-5d29-4c31-b605-2056ce2395fc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:15:55.990079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b2bb38f6-5d29-4c31-b605-2056ce2395fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:15:55.999896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:15:56.158841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca93b88-ba96-4dbf-a2ef-b95537f308ca None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:15:56.174905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca93b88-ba96-4dbf-a2ef-b95537f308ca None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:15:56.180444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:15:56.181793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:15:56.182063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:15:56.182332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:15:56.192316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:15:56.193916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92752a-8b75-46a6-9e72-2ed2ee244d11 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:15:56.204373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 768/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:00.151598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:00.152215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:00.152343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:00.153872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:00.159545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8340d9-02ca-4303-a1c0-1e4076a5cdbd None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:00.160046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8340d9-02ca-4303-a1c0-1e4076a5cdbd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:00.160152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8340d9-02ca-4303-a1c0-1e4076a5cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:00.179858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6f8340d9-02ca-4303-a1c0-1e4076a5cdbd None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:00.181716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6f8340d9-02ca-4303-a1c0-1e4076a5cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:00.189774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:00.266030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:00.267712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:00.346060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd1e70-a8d8-4e12-9e18-c04d576a11a9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:00.349880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:00.350489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:00.350769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:00.351042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:00.360633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:00.362058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f6c17-fb12-4006-a366-55aa11e72559 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:00.371481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 767/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:02.412551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278626-7003-44e3-b798-87504e84576d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:02.413271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278626-7003-44e3-b798-87504e84576d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:02.413271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278626-7003-44e3-b798-87504e84576d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:02.414474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:02.419980 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445bb5-ec90-4189-a3a0-d34206961cc9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:02.420530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445bb5-ec90-4189-a3a0-d34206961cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:02.420845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53445bb5-ec90-4189-a3a0-d34206961cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:02.442800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-53445bb5-ec90-4189-a3a0-d34206961cc9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:02.444100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-53445bb5-ec90-4189-a3a0-d34206961cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:02.453597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:02.490343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278626-7003-44e3-b798-87504e84576d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:02.501752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278626-7003-44e3-b798-87504e84576d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:02.505272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:02.505873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:02.506152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:02.518771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:02.518771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:02.518771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8d24-81bf-4805-9d0f-5a4fc83148f3 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:02.529036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 771/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:06.157983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:06.158591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:06.158591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:06.159928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 769/1540] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:06.166848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39318b5-f194-4473-a8b7-c15321348268 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:06.167388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39318b5-f194-4473-a8b7-c15321348268 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:06.167388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39318b5-f194-4473-a8b7-c15321348268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:06.188313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e39318b5-f194-4473-a8b7-c15321348268 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:06.189516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e39318b5-f194-4473-a8b7-c15321348268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:06.198045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 772/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:16:06.510533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:06.512301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:06.595311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8e21e-edc7-4115-86c2-e7a2d405a591 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:06.599050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:06.599664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:06.599970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:06.600247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:06.610191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:06.611617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4de7-cec7-45a9-834e-fe2758f4719b service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:06.621701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 770/1542] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:16:08.701358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:08.702065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:08.702065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:08.703499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 773/1543] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 05:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:16:08.710346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73fd64-f8c8-4286-8a26-89279a5c8a15 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:08.711362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73fd64-f8c8-4286-8a26-89279a5c8a15 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:08.712585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73fd64-f8c8-4286-8a26-89279a5c8a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:08.735608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1e73fd64-f8c8-4286-8a26-89279a5c8a15 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:16:08.736919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1e73fd64-f8c8-4286-8a26-89279a5c8a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:08.745682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 771/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 05:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:16:09.059041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:16:09.060804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:16:09.074499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f03cf-f302-4e98-9252-ef468a052979 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:16:09.078275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:16:09.078896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:16:09.079179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:16:09.079453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:16:09.089153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:16:09.090591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae41b-afca-436f-b722-d535ae3f3e2c service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:16:09.100153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 774/1545] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:16:18.729628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=85 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:19.095862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=27 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:37.559309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.560076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.560440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.585358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.587530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.600339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 772/1546] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.611189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770675-18b1-45fc-b37c-5f4fc8d9b163 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.611811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770675-18b1-45fc-b37c-5f4fc8d9b163 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.612217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8770675-18b1-45fc-b37c-5f4fc8d9b163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.666087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e8770675-18b1-45fc-b37c-5f4fc8d9b163 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.668311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e8770675-18b1-45fc-b37c-5f4fc8d9b163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.689915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 775/1547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.694636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:37.719411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf8e26-a761-47d4-94d5-64ac75b0cf91 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:37.724534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01daad-5e66-46c6-9c1d-7e0c25d9fd2c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.725051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01daad-5e66-46c6-9c1d-7e0c25d9fd2c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.725542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01daad-5e66-46c6-9c1d-7e0c25d9fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.726018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:37.727077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.727593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.728264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.729212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:37.729743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:37.731721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:37.764683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 773/1548] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:17:37.781300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:37.784071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7f01daad-5e66-46c6-9c1d-7e0c25d9fd2c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.786095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7f01daad-5e66-46c6-9c1d-7e0c25d9fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.808367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c100e-661f-410a-8307-51ed8d39653f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:37.813888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 776/1549] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.815126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8ead-f7ff-47e2-a202-28377b721adb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.815404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8ead-f7ff-47e2-a202-28377b721adb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.815687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8ead-f7ff-47e2-a202-28377b721adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.825000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:37.826761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.827608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.828586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.830292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:37.832799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:37.832799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:17:37.832799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:17:37.840027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:37.863664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9f2f8ead-f7ff-47e2-a202-28377b721adb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.864963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9f2f8ead-f7ff-47e2-a202-28377b721adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.890966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 777/1550] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.893398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f1186-dd2d-469a-90b1-627b9f7e7ebb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.894067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f1186-dd2d-469a-90b1-627b9f7e7ebb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.894816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f1186-dd2d-469a-90b1-627b9f7e7ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.938944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8e6f1186-dd2d-469a-90b1-627b9f7e7ebb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.940284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8e6f1186-dd2d-469a-90b1-627b9f7e7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:37.958224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 778/1551] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:37.959775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:37.960147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:37.960493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:37.997070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:37.998296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.012641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 779/1552] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.015085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.029630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdc1aa-8eb1-4a8e-8f93-de402a0dd79b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.038402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.039977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.039977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.040297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.040895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:38.041234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.043966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:38.043966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:17:38.043966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:17:38.043966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.061022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 774/1553] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:37 2022] POST /identity/v3/projects => generated 369 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:38.068243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.085019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 780/1554] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:38.091775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.123954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f38b6-cd1f-47b9-a8b3-976c023fdfda admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.327624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.334057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.334550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.338302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.341104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.346691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:38.346691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:17:38.346691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:17:38.349105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76be4fd-4c98-4019-ba84-dc3e676eafb6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.384099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff673e-ebef-4506-9f91-8555b27d38d6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.405209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.406365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.406840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.407308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.409177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:38.409798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.412775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.442153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 775/1555] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:38.443708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.477434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00783f-0765-4745-9dcf-5b2d151f034d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.483104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 781/1556] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/users => generated 285 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:38.491764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.493364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.493855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.504247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.505581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.506084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.506736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.508731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.512597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.535416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.537550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.553553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 782/1557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.556374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.572417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd4e2-9f37-49a1-8f4e-2c6da4b32fc3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.578173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.578886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.579303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.579583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.580299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.582342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf285-18c5-4edd-8035-b092f4b10155 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.654317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 776/1558] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:38.658418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.709805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 783/1559] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/projects => generated 359 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:38.712179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceccd4-85a1-4a78-82f2-4ab1fc0e4786 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.712525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceccd4-85a1-4a78-82f2-4ab1fc0e4786 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.712797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceccd4-85a1-4a78-82f2-4ab1fc0e4786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.740938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a5ceccd4-85a1-4a78-82f2-4ab1fc0e4786 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.743578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a5ceccd4-85a1-4a78-82f2-4ab1fc0e4786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.744320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98ccd4-5537-40e1-9f77-ec9390aaa0f0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.777760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:38.813212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.813843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.814156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.814465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.814987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 784/1560] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.815211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.816397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8fd6-153b-45be-ad87-de5867b463e4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.816711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8fd6-153b-45be-ad87-de5867b463e4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.816963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8fd6-153b-45be-ad87-de5867b463e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.817683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502880-c140-470e-ab11-802a48c7cc87 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.844352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 777/1561] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:38.844352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424cfa-7a2d-4037-abf3-1518fb7f9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.844352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424cfa-7a2d-4037-abf3-1518fb7f9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.844352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f424cfa-7a2d-4037-abf3-1518fb7f9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.846099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-988f8fd6-153b-45be-ad87-de5867b463e4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.846099 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-988f8fd6-153b-45be-ad87-de5867b463e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.856788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 785/1562] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.858293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.858690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.859199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.884336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.884924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3f424cfa-7a2d-4037-abf3-1518fb7f9cb5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.886270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.886491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f424cfa-7a2d-4037-abf3-1518fb7f9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.895958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 786/1563] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.896989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.904292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 778/1564] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.904292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.904292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.904292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.906834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:38.915009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a240b-4b56-4941-96f1-175483bc380a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.921858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.922651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.923072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.923482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.924487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.925286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:38.926651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:38.927484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865533ff-097f-41d4-9348-bf25cb3208f0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:38.938140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 779/1565] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:38.938440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:38.950065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a649b-9ecb-4be1-b8b8-a14b9a942312 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:38.955472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:38.958879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:38.958879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:38.958879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:38.958879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:38.959576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.053340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 787/1566] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.055485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b331-1294-423f-9062-774f507c7d48 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.055797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b331-1294-423f-9062-774f507c7d48 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.076891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b331-1294-423f-9062-774f507c7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.077069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 780/1567] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:38 2022] POST /identity/v3/users => generated 280 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.077069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.081249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bbe6b331-1294-423f-9062-774f507c7d48 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.083014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bbe6b331-1294-423f-9062-774f507c7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.093817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae52f3-c6c2-4004-9450-6e4a7663aa5a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.099129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 788/1568] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:39.100380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bb09-f850-45a3-a782-d725005adc1d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.100741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bb09-f850-45a3-a782-d725005adc1d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.100925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1bb09-f850-45a3-a782-d725005adc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.103282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.104680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.105125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.106842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.106842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.109623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.124388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-66c1bb09-f850-45a3-a782-d725005adc1d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.125604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-66c1bb09-f850-45a3-a782-d725005adc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.125780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 781/1569] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:39.127048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.135649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 789/1570] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:39.136978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.137267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.137536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.142768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611dce9-9165-4cb4-9db8-f4a9b45c406e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.149751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.150409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.150773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.151122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.152351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:39.152724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.154781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2e9a-51f7-48b8-95ac-2b60fe3e6d91 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.161479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.162714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.170881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 782/1571] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:39.171974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 790/1572] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:39.172725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.174904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.175748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.176589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.184573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d256d8-f384-4816-be7f-9881bcfb207a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.190325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.191097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.191494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.191947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.192869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.195767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.200989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.202213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.212594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 791/1573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:39.212594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.214709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 783/1574] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:39.215650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.221344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12e854-7d9f-408a-b813-4d5232fff957 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.226058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.227870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.228191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.228478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.229169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.230788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.233546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49931-92c2-4ad7-8767-4d6a4ea500e4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.241204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 792/1575] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:39.241360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.242142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.243139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.243457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.243996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.245381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:39.245948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.249079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.252105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0424a-638c-4f42-85d0-5a1ecae98f0a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.256791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.257464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.258279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.258566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] PATH_INFO: `/v3/projects/ab2b64e07d714bfd81554392c5a62e35/users/b60a6b9d21164fbd9ee3e4068a4dbf72/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.269687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 784/1576] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:39.271319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.275155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2b64e07d714bfd81554392c5a62e35, user_id=b60a6b9d21164fbd9ee3e4068a4dbf72, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.278149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.290172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b44bf-4ee8-4e99-b979-9268877e3e96 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.297801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.298821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.299305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.299786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.301082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:39.301624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.305146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.326235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 785/1577] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:39.327796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.344769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045ebc9-65cc-4cc8-a9e9-7bcc30081cbb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.359146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 793/1578] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:39 2022] PUT /identity/v3/projects/ab2b64e07d714bfd81554392c5a62e35/users/b60a6b9d21164fbd9ee3e4068a4dbf72/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:39.359146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.426396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.427072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.427357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.427636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.428394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:39.428699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.431181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0166-4030-4e3a-9eb9-1385b854507c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.431877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.438936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.440030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.440535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.441032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.442281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.444667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 786/1579] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:39.445573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.453206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.458336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d312cd0-5e57-4bec-a726-a57a6712ec40 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.463770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.464429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.464712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.464988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.465870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.467622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.480004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 787/1580] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:39.485308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.491211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1853-3216-46c9-810a-cd674dfba3dd admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.496319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.496942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.497226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.497501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.498203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:17:39.498505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.500157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.513529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 788/1581] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:17:39.514384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.526986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbdd6-5b0c-4adb-8ccd-63122d68dc00 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.532538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.533165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.533446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.533724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.534426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.536069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.537579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:39.548975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 794/1582] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.549842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.557954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 789/1583] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:39.557954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.568507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254bcb-a976-4a04-aba9-a9b27026c00e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.621728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280a592-00f0-4df2-bc04-c3af771cab67 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.626586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.627211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.627488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.627764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.628470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.630411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1386d2e-9b46-4ab3-9d17-76ccfbd35573 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.639564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.641158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:39.641481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.641968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.642441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.643632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.647829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.739816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 795/1584] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.743801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.744330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.744819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.770403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 790/1585] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.771979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.781488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] MFA Rules not processed for user `b60a6b9d21164fbd9ee3e4068a4dbf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:39.782910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:39.849406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce39eb5-2967-4734-8df4-41a870d0e8df admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.855669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.856588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.856957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.857291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.858055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.860460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.865677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 796/1586] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:39.866535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:39.881305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeb5bc-a9b1-4e70-89d2-4bc08566b0f8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:39.887944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:39.888652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:39.888938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:39.889218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] PATH_INFO: `/v3/projects/01181ff14a9346848cd9fcd176350018/users/edc76be4397f43ba9dbb4edd211ab48f/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:39.906072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=01181ff14a9346848cd9fcd176350018, user_id=edc76be4397f43ba9dbb4edd211ab48f, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:39.908807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:39.974721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 791/1587] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:39.975604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.001841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 797/1588] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:39 2022] PUT /identity/v3/projects/01181ff14a9346848cd9fcd176350018/users/edc76be4397f43ba9dbb4edd211ab48f/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:40.003733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.049226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a4-9345-4b88-9582-005efa9c749a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.060488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.085029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bd3c3-9399-4cb2-b568-cba9a14a06ac admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.090911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.091616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.091922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.092223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] PATH_INFO: `/v3/projects/ed3290175a5a47f2be29d8a614ac2ea1/users/46d4d74b680d4e408e6ecc51a37b69d7/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.111065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3290175a5a47f2be29d8a614ac2ea1, user_id=46d4d74b680d4e408e6ecc51a37b69d7, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.113971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.121299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.121948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.122227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.122571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.123281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.125218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.223818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 798/1589] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:40 2022] PUT /identity/v3/projects/ed3290175a5a47f2be29d8a614ac2ea1/users/46d4d74b680d4e408e6ecc51a37b69d7/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:40.224928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.241344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 792/1590] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:39 2022] POST /identity/v3/projects => generated 393 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.244186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.274442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.300227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137175-bee0-4aa4-b014-7852b98a73fc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.322475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037002-9667-48c6-8b96-a139dc17371b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.328428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.329369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.329826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.330217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.331102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.333956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.372518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.373151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.373434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.373723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.374459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.376527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.441434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 793/1591] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.442358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.452692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804ee0b-8fa8-43c9-a8fc-8397188da3de admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.457838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.458552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.458832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.459108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.459793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.462400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.471300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 799/1592] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.472682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.484693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7def-cb38-4f40-bf56-aea5182a40d1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.489853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.490668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.490946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.491220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.492027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.494621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9653ec7-e14f-479f-a867-bb7954ba6590 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.555896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 794/1593] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.556767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.567206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e9db6-5a4a-4de8-8c30-bd30ce21d9c6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.572336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.573114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.573486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.573851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.574669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.577240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fb105-33cc-4291-9595-ea36e9872804 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.588374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 800/1594] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.592657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.592657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.592657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.623495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] MFA Rules not processed for user `edc76be4397f43ba9dbb4edd211ab48f`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:40.624737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:40.665082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 795/1595] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.666317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.666668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.667324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.705735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] MFA Rules not processed for user `46d4d74b680d4e408e6ecc51a37b69d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:40.707094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:40.722246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 801/1596] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:40.722246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.777884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.778925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:40.800871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acad8e-8497-4c25-9860-0edb49f34d62 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.807192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.807444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 796/1597] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:40.807926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.808309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.808665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.809324 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.809652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.811368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.823118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0595f4-354d-441d-ae38-9b3030352cb5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.828997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.829720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.830067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.830430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.831206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.833145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.844909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 797/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:40.845726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.860100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27277bf-f611-4c6a-8a56-b3a2186db99b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.865157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.865847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.866172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.866509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.868355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.870138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.880825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 798/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:40.881699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.893063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296ca7-5a4a-45f7-84ab-17fe70e55621 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.897941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.899432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.899941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.900228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.901071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.902973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.915157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 799/1600] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:40.917902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.926069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2127-8601-4b4d-b781-99f393a4621c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.930875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.931550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.931838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.932238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.932937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.934879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.944389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 802/1601] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:40.946020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:40.958693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904fc1-8c2b-4394-a43e-bdfc5d925c94 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:40.966646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:40.967709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.968248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.968736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.969747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:40.972705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab5fdd-9f22-481f-90c9-99d5025c3a06 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:40.993300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 803/1602] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:40.995598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759af56-5465-4125-9ec3-4884d1ecad5b None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:40.996134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759af56-5465-4125-9ec3-4884d1ecad5b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:40.996625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759af56-5465-4125-9ec3-4884d1ecad5b None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:40.998961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 804/1603] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 05:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:41.000188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759af56-5465-4125-9ec3-4884d1ecad5b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.065756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 800/1604] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:40 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:41.065756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.069434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759af56-5465-4125-9ec3-4884d1ecad5b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.075128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.076169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.076623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.077038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.077137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2114-73a8-4504-96bb-11f5ee2af950 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.089806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.090549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.090988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.091448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.092692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.094779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.096890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.098381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.109800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 801/1605] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.110089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 805/1606] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:41.110385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.110874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.122978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254525-e5ea-43d8-8e91-9af59079d877 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.126308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4d69-ade0-457d-bdd8-ca17f14f95e2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.128319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.128945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.129224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.129497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.130284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.131848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.134383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.135379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.135793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.136463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.137324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.139724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.145118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 806/1607] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.150567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.160969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 802/1608] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.160969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.173346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686775-553b-4d50-8580-11a118d7011b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.176804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fe336-5c3f-4e7f-a4b8-762e944b015c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.182654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.183853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.184424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.184823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.185621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.186234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.186589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.187107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.187496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.188710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.189266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1103151-4d6f-46d8-bf65-3f15c6583be0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.191492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.217927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 807/1609] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.218735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 803/1610] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.218735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.219066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.219066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.219066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.236529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70807-83ee-4e48-b60f-2afc5d61d01b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.244595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.245582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.246563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.246920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.248072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.252685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.272549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 804/1611] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.276253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.287104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:41.291694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:41.292574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0e845-0939-4e83-a0e5-e51562862ed6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.297786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.298590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.298996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.299353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] PATH_INFO: `/v3/projects/a821bf10ffb1420ea3ecff42f7355d42/users/fe7723d1854c42b9b1b3684c8d2daff0/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.327959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a821bf10ffb1420ea3ecff42f7355d42, user_id=fe7723d1854c42b9b1b3684c8d2daff0, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.330151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:41.330151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:17:41.330151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:17:41.334129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.399408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 808/1612] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 05:17:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:41.400739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.418309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d23e9-1cf4-47ea-83e0-4166e0e17edc None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.429212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 805/1613] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:41 2022] PUT /identity/v3/projects/a821bf10ffb1420ea3ecff42f7355d42/users/fe7723d1854c42b9b1b3684c8d2daff0/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:41.429212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.448091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:41.509917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402131e8-871f-417e-918f-a50b63052a4e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.512104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.512795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.513159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.513393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] PATH_INFO: `/v3/projects/3ebd2b0b5640459d9f1ba9a454b98b66/users/7bcdc8e68aa247f7b0cbd41a2ca61967/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.516412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.517475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.517935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.518361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] PATH_INFO: `/v3/projects/985e0d47f2024a218fb1d186958bfc05/users/0107687c5de7444d933b1ddc926ea027/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.535862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebd2b0b5640459d9f1ba9a454b98b66, user_id=7bcdc8e68aa247f7b0cbd41a2ca61967, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.539124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.540203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985e0d47f2024a218fb1d186958bfc05, user_id=0107687c5de7444d933b1ddc926ea027, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.542943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.629978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 809/1614] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:41 2022] PUT /identity/v3/projects/3ebd2b0b5640459d9f1ba9a454b98b66/users/7bcdc8e68aa247f7b0cbd41a2ca61967/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:41.630799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.666722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 806/1615] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:41 2022] PUT /identity/v3/projects/985e0d47f2024a218fb1d186958bfc05/users/0107687c5de7444d933b1ddc926ea027/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:41.668310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.684708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:41.713997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b46f0-692e-4eb5-815d-4cc057934a46 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.766391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e1280-bf19-4e8a-bb65-2536021a1612 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.774424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.774424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.774424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.774424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.774914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.775501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.776867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.777532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.777807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.778299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] PATH_INFO: `/v3/projects/771a1124e14144ee8037cb2b26452d8c/users/089d2e686b2245dab52ff78ddfa8cb00/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.786908 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 807/1616] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:41.787946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.802243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e0f3-6581-430a-a0bd-e4aaa6402af3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:41.806068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] RBAC: Authorizing `identity:create_grant(project_id=771a1124e14144ee8037cb2b26452d8c, user_id=089d2e686b2245dab52ff78ddfa8cb00, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.808098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:41.808772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.809068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.809331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] PATH_INFO: `/v3/projects/2eb385110a044ca093af6cf7d5c607ce/users/8c27c37ae56c4303b465e360e2a2514e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:41.811450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.829145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb385110a044ca093af6cf7d5c607ce, user_id=8c27c37ae56c4303b465e360e2a2514e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:41.832485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9ec6-8be7-4bd9-b2ed-d4a808bbf99c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:41.944626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 810/1617] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:41 2022] PUT /identity/v3/projects/771a1124e14144ee8037cb2b26452d8c/users/089d2e686b2245dab52ff78ddfa8cb00/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:41.945858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:41.991219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:41.994539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 808/1618] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:41 2022] PUT /identity/v3/projects/2eb385110a044ca093af6cf7d5c607ce/users/8c27c37ae56c4303b465e360e2a2514e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:41.996192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c0a2-e417-4471-bc38-e57476fe2f34 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:41.996635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c0a2-e417-4471-bc38-e57476fe2f34 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:41.997102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c0a2-e417-4471-bc38-e57476fe2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.027747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6be0c0a2-e417-4471-bc38-e57476fe2f34 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:42.029241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6be0c0a2-e417-4471-bc38-e57476fe2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:42.039678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157de6-3b66-4aaa-a0cd-62ca4509724f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.099596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 809/1619] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:42.104478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.104478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.104478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.116126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.116126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.116126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.116126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.135954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] MFA Rules not processed for user `7bcdc8e68aa247f7b0cbd41a2ca61967`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:42.137269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:42.184559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.187046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dab61-dac1-4ee4-a164-f83950da5c70 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.198152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 811/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:42.199335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27008e-69e5-46af-9d6d-3bf7b4fce5f6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.199620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27008e-69e5-46af-9d6d-3bf7b4fce5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.199895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27008e-69e5-46af-9d6d-3bf7b4fce5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.229151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 810/1621] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:42.231105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.233364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cb27008e-69e5-46af-9d6d-3bf7b4fce5f6 None None] MFA Rules not processed for user `0107687c5de7444d933b1ddc926ea027`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:42.234666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cb27008e-69e5-46af-9d6d-3bf7b4fce5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:42.245466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56300302-9b30-4d07-bbde-9b8be52d12fb None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.252341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.255278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.255278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.255278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] PATH_INFO: `/v3/projects/4b5b45382d914f1a9c6dc010d0c199c6/users/071141217ce84c2aac232628ff5d0de2/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.259048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:42.292480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5b45382d914f1a9c6dc010d0c199c6, user_id=071141217ce84c2aac232628ff5d0de2, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.297779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.340930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:42.345126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 812/1622] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:42.346795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.347269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.347692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.373822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:42.375092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:42.397649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 813/1623] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:42.399878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.401197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 811/1624] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:42 2022] PUT /identity/v3/projects/4b5b45382d914f1a9c6dc010d0c199c6/users/071141217ce84c2aac232628ff5d0de2/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:42.403772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.415406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d724-6ae1-44b7-ae37-004be2139d85 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.473491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54734c13-648a-4ea7-aa3f-9466ea9f7a4d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.479113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.479897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.480221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.480500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.496747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.497376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.497659 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.497937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.498639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.500346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.518382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 814/1625] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:42.518382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.543495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a91-f34e-4259-bc92-53c5aa5abcec admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.552043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.552885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.553417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.553694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.555794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.557880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.558611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.560369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.573698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 812/1626] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:42.574881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.585985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2e164-9d40-4877-9903-2b9b1e4419dc service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.591380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.592103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.592394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.592671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.593363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.595336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0058d-7fd7-4c9b-80e9-3676bc6b7f31 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.711204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 813/1627] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:42.711586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 815/1628] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:42.714922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.715142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f49f-4d7e-4fda-8b1d-ec7512b8dca9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.715142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f49f-4d7e-4fda-8b1d-ec7512b8dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.715142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f49f-4d7e-4fda-8b1d-ec7512b8dca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.741115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f628f49f-4d7e-4fda-8b1d-ec7512b8dca9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:42.744470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f628f49f-4d7e-4fda-8b1d-ec7512b8dca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:42.801355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905d4a-9c6f-4394-be24-e5f1fbd32401 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.806477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.807126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.807415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.807693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.834665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 814/1629] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:42.836784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007008-79fc-47db-8a89-b4932933ae24 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.837251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007008-79fc-47db-8a89-b4932933ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.837784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007008-79fc-47db-8a89-b4932933ae24 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.840791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 815/1630] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 05:17:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:42.841992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf007008-79fc-47db-8a89-b4932933ae24 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.862046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf007008-79fc-47db-8a89-b4932933ae24 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.868309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:42.868990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:42.869413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:42.869988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] PATH_INFO: `/v3/projects/2eb385110a044ca093af6cf7d5c607ce/users/8c27c37ae56c4303b465e360e2a2514e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:42.872572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb385110a044ca093af6cf7d5c607ce, user_id=8c27c37ae56c4303b465e360e2a2514e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.876623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.889212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:42.895876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 816/1631] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:42 2022] PUT /identity/v3/projects/2eb385110a044ca093af6cf7d5c607ce/users/8c27c37ae56c4303b465e360e2a2514e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:42.900985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.920817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:42.922860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:42.936542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 816/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:42.937813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:42.948993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477d847-2880-49ff-bb1f-507a3cecac63 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:42.976931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:43.002341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090aa8e-19cf-4b95-9de7-29a2d5d2a06b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.009815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.010628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.010969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.011315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.012108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.014515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.048064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.048697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.048978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.049253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.049960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.051999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d912f3-d7ee-4876-89ac-78626cfc0ab8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.175311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 817/1633] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:43.176968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.237006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 817/1634] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:17:42 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:17:43.237006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.237006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.237694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.241221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18feb64-8834-4afa-adbc-df9df3ae403d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.246467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.247105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.247421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.247654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.260971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.262476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f62a0-b385-4a66-9703-eda19b58d2a1 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.267732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:43.269457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:43.275942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 818/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:43.277513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.277791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.278182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.318725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] MFA Rules not processed for user `8c27c37ae56c4303b465e360e2a2514e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:43.321389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:43.378709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 818/1636] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:17:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:43.380302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.397297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398247f-062d-40f5-87e2-0423df871d75 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.404331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.405042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.405343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.405628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.406869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.409692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.427771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 819/1637] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:43.427771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.439938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410c9a-24fa-4464-9b1e-41079acb8962 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.446997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.447634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.447634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.447634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.449672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.451074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.460208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 819/1638] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:43.462350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.477109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 820/1639] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:43.477109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.489745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0785-75e4-40b5-ac69-8f2f6921d0d9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.494065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:43.498717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.499959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.500552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.501072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] PATH_INFO: `/v3/projects/700a4fae456f4ea7b206b67d4522c8a8/users/61ba0b403f4949589c28f2447abad649/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.528390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=700a4fae456f4ea7b206b67d4522c8a8, user_id=61ba0b403f4949589c28f2447abad649, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.531577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.550405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec059-0adc-4a55-a053-c624cc063b0b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.565398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.566541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.566917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.567143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.582899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.585348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.599240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 820/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:43.600084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.610464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51a813-10a6-4051-ada7-563e82df6fb2 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.615163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.616076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.622808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.622808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.625012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 821/1641] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:43 2022] PUT /identity/v3/projects/700a4fae456f4ea7b206b67d4522c8a8/users/61ba0b403f4949589c28f2447abad649/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:43.629493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.645777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.648053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.684332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 821/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:43.685724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.716664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23cbc-8beb-46a6-a2c6-7e57c33b6d6f service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.822331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:43.856187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581cc66-3846-4f71-a21e-bf996e14e05e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.858547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.859347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.859636 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.860338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.860663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.866607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.870100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.872427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.873165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.873799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] PATH_INFO: `/v3/projects/8855d9adea20479190372db63a344ea6/users/fea7d36793d8462b99fbe908a70a5289/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.894386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 822/1643] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:43.897117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:43.921569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849230-e0b1-4f40-9948-ba7e8ea310f8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:43.936729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:43.937437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.937725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.938007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] PATH_INFO: `/v3/projects/700a4fae456f4ea7b206b67d4522c8a8/users/61ba0b403f4949589c28f2447abad649/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:43.943256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700a4fae456f4ea7b206b67d4522c8a8, user_id=61ba0b403f4949589c28f2447abad649, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.946934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b4985-e11e-468a-9895-56c45b41c2b4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.952391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855d9adea20479190372db63a344ea6, user_id=fea7d36793d8462b99fbe908a70a5289, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:43.959089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:43.973391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 823/1644] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:43 2022] PUT /identity/v3/projects/700a4fae456f4ea7b206b67d4522c8a8/users/61ba0b403f4949589c28f2447abad649/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:43.993714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:43.993714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:43.994695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.045717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] MFA Rules not processed for user `61ba0b403f4949589c28f2447abad649`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:44.047723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:44.076052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 822/1645] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:43 2022] PUT /identity/v3/projects/8855d9adea20479190372db63a344ea6/users/fea7d36793d8462b99fbe908a70a5289/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:44.078716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:44.229638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b25de-c237-497a-ba01-caf52cc02656 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:44.247238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:44.248021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.248360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.248646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.249403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:44.251259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:44.276092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 824/1646] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:17:44.285075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 823/1647] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:17:44.293121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:44.319045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:44.415642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2c11-6e29-495c-bbfd-9a7fcacbf9f8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:44.432323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:44.434373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.435745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.435975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] PATH_INFO: `/v3/projects/8855d9adea20479190372db63a344ea6/users/fea7d36793d8462b99fbe908a70a5289/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.436303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:44.439956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855d9adea20479190372db63a344ea6, user_id=fea7d36793d8462b99fbe908a70a5289, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:44.446887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f694b-7093-43ca-86df-ca18219396ef admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:44.476004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 825/1648] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:17:44 2022] PUT /identity/v3/projects/8855d9adea20479190372db63a344ea6/users/fea7d36793d8462b99fbe908a70a5289/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:44.479284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.479565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.481235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.547147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] MFA Rules not processed for user `fea7d36793d8462b99fbe908a70a5289`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:44.548358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:44.571360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5bd1a-37a4-4f6b-926e-bb9450943a89 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:44.723010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:44.724126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:44.724411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:44.725186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:44.754313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 826/1649] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:44.804143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:44.863868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:44.867969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ae2fb-414c-45a8-8ddf-12745ad262ad service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:44.890514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 824/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:45.044025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:45.061449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300571-22e6-43a8-ace4-95e6a8f422b1 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:45.075396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:45.076352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.076867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.077386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.433369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:45.433369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06619b3c-b6cf-4881-8523-538a9c169158 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:45.433369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 827/1651] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:45.435060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee6ec-b750-4a09-af30-568a77c0d3f7 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.435060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee6ec-b750-4a09-af30-568a77c0d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.435060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaee6ec-b750-4a09-af30-568a77c0d3f7 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.435060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 825/1652] 10.222.0.36 () {54 vars in 962 bytes} [Thu Aug 4 05:17:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec8a-ba01-4da8-845d-5b1f9c163534 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec8a-ba01-4da8-845d-5b1f9c163534 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec8a-ba01-4da8-845d-5b1f9c163534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3b80ec8a-ba01-4da8-845d-5b1f9c163534 None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3b80ec8a-ba01-4da8-845d-5b1f9c163534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:45.463643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:45.484135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 828/1653] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Aug 4 05:17:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:45.494208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafdab-6b56-4d20-bf1a-c80c5fe6f54d None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.494747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafdab-6b56-4d20-bf1a-c80c5fe6f54d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.495232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafdab-6b56-4d20-bf1a-c80c5fe6f54d None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.497792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 826/1654] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 05:17:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:45.506875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.508695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.509821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.552268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:45.555637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:45.593869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbafdab-6b56-4d20-bf1a-c80c5fe6f54d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:45.603113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 829/1655] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:17:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:45.611435 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbafdab-6b56-4d20-bf1a-c80c5fe6f54d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:45.624020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:45.624020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:45.624020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:45.624020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:45.759713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:45.761627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:45.774002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 827/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:46.591649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:46.629989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963a9b-b473-4f14-8c8d-123618bb732e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:46.646747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:46.656735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:46.656735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:46.656735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:46.771170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:46.775196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994672d-d67f-4e3b-a6d3-2dbb0ca84914 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:46.801966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 830/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:52.013009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:52.041910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed4fe-31bc-47ca-a752-be1f71a88866 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:52.062431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:52.063848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:52.064599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:52.065219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:52.105641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:52.110814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f96b5-a9d7-48df-b228-fc7cb2b166b9 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:52.160040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 828/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:53.137352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:53.137352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:53.137352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:53.234764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] MFA Rules not processed for user `fe7723d1854c42b9b1b3684c8d2daff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:53.236189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:53.424855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 831/1659] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:53.436433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc95ab-a10f-4154-9a3a-fa12fb00fe6d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:53.441228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc95ab-a10f-4154-9a3a-fa12fb00fe6d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:53.441228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc95ab-a10f-4154-9a3a-fa12fb00fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:53.487077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e2fc95ab-a10f-4154-9a3a-fa12fb00fe6d None None] MFA Rules not processed for user `fe7723d1854c42b9b1b3684c8d2daff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:53.490011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2fc95ab-a10f-4154-9a3a-fa12fb00fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:53.511704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 829/1660] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:53.587390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:53.610722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f4c08-1fa1-42b9-a8eb-770249f6ce99 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:53.633999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:53.634652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:53.634938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:53.635218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:53.650663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:53.652667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f720d13-a234-460f-86fa-2848dd30de1b service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:53.692100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 832/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:54.611126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.611640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.611939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.614550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 830/1662] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 05:17:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:54.639013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa19e3-c9e3-4a2f-98f0-a6b96a9e327e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.641866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa19e3-c9e3-4a2f-98f0-a6b96a9e327e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.641866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa19e3-c9e3-4a2f-98f0-a6b96a9e327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.762840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-85fa19e3-c9e3-4a2f-98f0-a6b96a9e327e None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:54.764338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85fa19e3-c9e3-4a2f-98f0-a6b96a9e327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:54.880157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 833/1663] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:54.897344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:54.899741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:54.925771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e7a2-b7a6-474b-9f43-0f075e88d110 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:54.932053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:54.933142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:54.933645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:54.935133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:54.952339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:54.954284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9aa9a-73cc-41ed-be68-90d0a32d042e service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:54.999750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 831/1664] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:17:56.368529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be005-64f6-4c93-a4cc-846aa8cdf471 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:56.374971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be005-64f6-4c93-a4cc-846aa8cdf471 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:56.374971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be005-64f6-4c93-a4cc-846aa8cdf471 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:56.374971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 834/1665] 10.222.0.36 () {54 vars in 961 bytes} [Thu Aug 4 05:17:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:17:56.383500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:56.384193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:56.384193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:56.438400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:56.445201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:56.721934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740be005-64f6-4c93-a4cc-846aa8cdf471 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:56.786638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 832/1666] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Aug 4 05:17:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:56.787045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:56.787729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:56.883229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:56.923276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684fe2-620a-41b5-aaf6-0769d5b3f381 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:56.929194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:56.930267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:56.930765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:56.931052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740be005-64f6-4c93-a4cc-846aa8cdf471 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:56.931418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] PATH_INFO: `/v3/users/b60a6b9d21164fbd9ee3e4068a4dbf72` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:56.933170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60a6b9d21164fbd9ee3e4068a4dbf72)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:56.935720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:56.957518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:56.959428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:56.960843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:56.962767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] PATH_INFO: `/v3/users/edc76be4397f43ba9dbb4edd211ab48f` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:56.966531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc76be4397f43ba9dbb4edd211ab48f)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:56.971771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: WARNING py.warnings [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:56.971771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: warnings.warn(msg) Aug 04 05:17:56.971771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: Aug 04 05:17:56.976614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:57.232493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60a6b9d21164fbd9ee3e4068a4dbf72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.253910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60a6b9d21164fbd9ee3e4068a4dbf72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.255567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60a6b9d21164fbd9ee3e4068a4dbf72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.307882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60a6b9d21164fbd9ee3e4068a4dbf72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.310321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc76be4397f43ba9dbb4edd211ab48f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.363667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc76be4397f43ba9dbb4edd211ab48f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.370035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc76be4397f43ba9dbb4edd211ab48f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.375929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc76be4397f43ba9dbb4edd211ab48f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.414062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60a6b9d21164fbd9ee3e4068a4dbf72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.428043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4c11109a-b8b7-4657-b97c-5877da57fdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc76be4397f43ba9dbb4edd211ab48f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:57.440554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 833/1667] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:17:56 2022] DELETE /identity/v3/users/b60a6b9d21164fbd9ee3e4068a4dbf72 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:57.446008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:57.467076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.612864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 835/1668] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:17:56 2022] DELETE /identity/v3/users/edc76be4397f43ba9dbb4edd211ab48f => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:17:57.618028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507abe-0711-4a42-ad56-62914831bd94 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.618311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507abe-0711-4a42-ad56-62914831bd94 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.619865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507abe-0711-4a42-ad56-62914831bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.653311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-95507abe-0711-4a42-ad56-62914831bd94 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:57.655812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-95507abe-0711-4a42-ad56-62914831bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.705554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d209186-3e11-4fee-8f9c-366a95dfc945 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:57.798958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 836/1669] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:57.800725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:57.801297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:57.802359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:57.840781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:17:57.842429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.890768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 837/1670] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:17:57.890768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:57.890768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:57.972450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:58.027575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:58.028405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:58.028781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:58.028888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:58.029346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:58.043630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:58.109398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f03f3-fdb6-41ad-945e-778458c90268 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:58.109605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:58.117171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:58.123218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:58.123978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:58.124263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:58.124542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:58.141158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 834/1671] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:58.141964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:58.146039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:58.148241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:58.166162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c489191-cde9-426c-88ee-f174415d3210 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:58.179761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 838/1672] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:58.181275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:58.185633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:58.186301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:58.188705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:58.240465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:58.247828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:58.285678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 835/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:17:59.443438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:59.445243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:59.482210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb33b8-a424-4755-9aca-b262b51238ae service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:59.502911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:59.503584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:59.503935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:59.504242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] PATH_INFO: `/v3/projects/ab2b64e07d714bfd81554392c5a62e35` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:59.505809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2b64e07d714bfd81554392c5a62e35)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:59.513599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:17:59.743272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2b64e07d714bfd81554392c5a62e35', 'request_id': 'req-1da4e8ba-9797-4a70-98da-84a46457ab13'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:59.760479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2b64e07d714bfd81554392c5a62e35', 'request_id': 'req-1da4e8ba-9797-4a70-98da-84a46457ab13'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:59.838547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:59.842697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:59.860964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2b64e07d714bfd81554392c5a62e35', 'request_id': 'req-1da4e8ba-9797-4a70-98da-84a46457ab13'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:59.863927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91984-743f-464e-802e-e6b32ba1a81e service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:17:59.897125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] The token cache is being invalidate because project ab2b64e07d714bfd81554392c5a62e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:17:59.899834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:59.901607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:17:59.910968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 839/1674] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:17:59 2022] DELETE /identity/v3/projects/ab2b64e07d714bfd81554392c5a62e35 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:17:59.912229 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:17:59.914299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:17:59.950699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:17:59.951376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:17:59.951543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:17:59.951834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] PATH_INFO: `/v3/projects/01181ff14a9346848cd9fcd176350018` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:17:59.953161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01181ff14a9346848cd9fcd176350018)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:17:59.954215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: WARNING py.warnings [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 05:17:59.954215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: warnings.warn(msg) Aug 04 05:17:59.954215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: Aug 04 05:17:59.956389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:00.098738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e8ba-9797-4a70-98da-84a46457ab13 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:00.105433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:00.106421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.106666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.106947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] PATH_INFO: `/v3/users/8c27c37ae56c4303b465e360e2a2514e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.108250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c27c37ae56c4303b465e360e2a2514e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:00.110241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:00.249963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01181ff14a9346848cd9fcd176350018', 'request_id': 'req-19bb4f07-7025-4ced-a47d-b30bab63279b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.273800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01181ff14a9346848cd9fcd176350018', 'request_id': 'req-19bb4f07-7025-4ced-a47d-b30bab63279b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.341835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c27c37ae56c4303b465e360e2a2514e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.357011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c27c37ae56c4303b465e360e2a2514e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.358531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c27c37ae56c4303b465e360e2a2514e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.359709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c27c37ae56c4303b465e360e2a2514e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.360905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01181ff14a9346848cd9fcd176350018', 'request_id': 'req-19bb4f07-7025-4ced-a47d-b30bab63279b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.365351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:00.389882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] The token cache is being invalidate because project 01181ff14a9346848cd9fcd176350018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:00.392888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.394833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-19bb4f07-7025-4ced-a47d-b30bab63279b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.402550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 836/1675] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:17:59 2022] DELETE /identity/v3/projects/01181ff14a9346848cd9fcd176350018 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:00.407569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.408671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.409051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.412430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-25dc0577-5428-4788-ac39-7c46a1f8e13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c27c37ae56c4303b465e360e2a2514e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:00.486114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] MFA Rules not processed for user `089d2e686b2245dab52ff78ddfa8cb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:00.488407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.518850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 840/1676] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:17:59 2022] DELETE /identity/v3/users/8c27c37ae56c4303b465e360e2a2514e => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:00.521753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b86c-1873-4b97-8e59-64eccc451405 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.523063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b86c-1873-4b97-8e59-64eccc451405 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.524372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b86c-1873-4b97-8e59-64eccc451405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.587483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b4e0b86c-1873-4b97-8e59-64eccc451405 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:00.592191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b4e0b86c-1873-4b97-8e59-64eccc451405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.654653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:00.676575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 837/1677] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:00.704452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:00.706672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.749804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 841/1678] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:00.760859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.761447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.766206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.826138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:00.833530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:00.883146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 842/1679] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:00.887148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:00.915781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614afe9-bad3-4c21-9cda-8762d764beb7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:00.920824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b90633-7c82-40fe-bdb3-789a9af2a3d8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:00.945263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:00.946576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:00.946790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:00.947075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:00.948197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:00.948628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:00.950770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:00.989721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 843/1680] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:00.990871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:01.032556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce309f-eb52-4fdb-a5ff-c06db1200c22 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:01.084252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.085200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.091224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.091224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.091224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.107501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.206640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.207761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.208295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.221985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.265550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 844/1681] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:00 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:01.266620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:01.271837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:01.445931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2240dd7-d429-409a-b6be-ea74bdbda30e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:01.468999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.475362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.476871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.476871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.477092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.477680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] PATH_INFO: `/v3/users/0107687c5de7444d933b1ddc926ea027` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.480768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0107687c5de7444d933b1ddc926ea027)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.485107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.498542 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 838/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:01.499373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:01.527235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507334a7-45e1-476f-b36e-77cae9e70c5a service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:01.536807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.537410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.537700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.538029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.539332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.541404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.702122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 839/1683] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:01 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:01.703315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:01.708367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:01.773027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:01.784134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d258c-e3b6-4666-8e66-fe6a3898299e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:01.785899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0107687c5de7444d933b1ddc926ea027'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:01.802905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0107687c5de7444d933b1ddc926ea027'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:01.806653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0107687c5de7444d933b1ddc926ea027'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:01.807634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0107687c5de7444d933b1ddc926ea027'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:01.821547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:01.822775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.823291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.828634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] PATH_INFO: `/v3/projects/2eb385110a044ca093af6cf7d5c607ce` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:01.831409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb385110a044ca093af6cf7d5c607ce)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:01.836133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:01.840092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6470ee15-d180-4607-8c56-ad2a6c345f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0107687c5de7444d933b1ddc926ea027'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:01.964487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 845/1684] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:01 2022] DELETE /identity/v3/users/0107687c5de7444d933b1ddc926ea027 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:01.968960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:01.968960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:01.968960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.008666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb385110a044ca093af6cf7d5c607ce', 'request_id': 'req-c975c41f-2a53-4ae0-a1e2-6e9920629361'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.023228 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb385110a044ca093af6cf7d5c607ce', 'request_id': 'req-c975c41f-2a53-4ae0-a1e2-6e9920629361'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.042062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:02.054537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] MFA Rules not processed for user `071141217ce84c2aac232628ff5d0de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:02.056421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.133231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb385110a044ca093af6cf7d5c607ce', 'request_id': 'req-c975c41f-2a53-4ae0-a1e2-6e9920629361'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.161598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] The token cache is being invalidate because project 2eb385110a044ca093af6cf7d5c607ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:02.161900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.170861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.172873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 840/1685] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:01 2022] DELETE /identity/v3/projects/2eb385110a044ca093af6cf7d5c607ce => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:02.181987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:02.182872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.200600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 846/1686] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:02.209893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:02.213601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.334007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c41f-2a53-4ae0-a1e2-6e9920629361 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:02.441689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:02.442616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.442755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.443031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.452410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:02.462360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f7788-d044-4264-b800-7f53b06ff460 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:02.462735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32f9b-6f18-47b8-87ef-86c0dda8d895 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:02.476701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:02.478075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.478308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.478673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] PATH_INFO: `/v3/users/46d4d74b680d4e408e6ecc51a37b69d7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.481835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d4d74b680d4e408e6ecc51a37b69d7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:02.483880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:02.492402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 841/1687] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:02.493856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25383-358a-40cc-9bb2-770e3d2baefc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.498258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25383-358a-40cc-9bb2-770e3d2baefc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.498258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25383-358a-40cc-9bb2-770e3d2baefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.526771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bcc25383-358a-40cc-9bb2-770e3d2baefc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:02.528807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bcc25383-358a-40cc-9bb2-770e3d2baefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.543472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 842/1688] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:02.546560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35821c8-58b4-4f93-892e-d84374967636 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.556071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35821c8-58b4-4f93-892e-d84374967636 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.556071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35821c8-58b4-4f93-892e-d84374967636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.585036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d35821c8-58b4-4f93-892e-d84374967636 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:02.590897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d35821c8-58b4-4f93-892e-d84374967636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.604694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 843/1689] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:02.607006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.607356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.607639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.634791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] MFA Rules not processed for user `071141217ce84c2aac232628ff5d0de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:02.635997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.650638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 844/1690] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:02.652072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:02.667794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416011-a166-4a7a-a2ae-2de2440b9003 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:02.673636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:02.674586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.674937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.675286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.676149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:02.677991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:02.701508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 845/1691] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:02.702639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:02.704597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:02.822020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d4d74b680d4e408e6ecc51a37b69d7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.846209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d4d74b680d4e408e6ecc51a37b69d7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.847680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d4d74b680d4e408e6ecc51a37b69d7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.851415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d4d74b680d4e408e6ecc51a37b69d7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.912829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d324d495-410d-4944-b923-7d561af49597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d4d74b680d4e408e6ecc51a37b69d7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:02.944926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:02.962699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b951ee-f497-4c5e-91d5-37a0f670e2a2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:02.969591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:02.971290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:02.971826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:02.973390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:02.983460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.010196 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 847/1692] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:02 2022] DELETE /identity/v3/users/46d4d74b680d4e408e6ecc51a37b69d7 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:03.012047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.012501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.013000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.018271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:03.022021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:03.049883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 846/1693] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:03.050891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:03.056778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.058132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:03.059310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.223054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:03.270766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 848/1694] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:03.272224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:03.277493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.308675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8d78-a715-48fc-b5a8-d8b8be21d44b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:03.320411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:03.322414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.323104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.323470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] PATH_INFO: `/v3/projects/376e908cc4014350a0cc3674396224d1/users/db900a1b198d4266a3997938f8927b33/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.329511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c395a3-d28c-4f25-849b-3d00cd9a833b service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:03.357340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376e908cc4014350a0cc3674396224d1, user_id=db900a1b198d4266a3997938f8927b33, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:03.367267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b19cb-ebae-4fc5-8af7-fc89e81bbd13 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:03.488520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 849/1695] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:03 2022] PUT /identity/v3/projects/376e908cc4014350a0cc3674396224d1/users/db900a1b198d4266a3997938f8927b33/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:03.488520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13befb72-c5b9-4949-b98c-29602d476bc5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.488520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13befb72-c5b9-4949-b98c-29602d476bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.488520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13befb72-c5b9-4949-b98c-29602d476bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.540829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-13befb72-c5b9-4949-b98c-29602d476bc5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:03.543857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-13befb72-c5b9-4949-b98c-29602d476bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.569761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:03.570502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.570788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.574339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.578243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.734319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:03.736535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:03.778930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 847/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:03.781449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:03.781716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 850/1697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:03.785018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.785018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.785018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.828717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5c28a-3db2-4448-b1ff-c36250bc447c service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:03.848772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:03.849430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:03.849716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:03.849995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:03.857146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:03.857466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:03.863371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:03.874051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] MFA Rules not processed for user `db900a1b198d4266a3997938f8927b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:03.878949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:03.939333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 848/1698] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:03.942786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:03.951774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:04.117500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 851/1699] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:04.118889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:04.123790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe810e2-61f6-4a81-8797-1190300afe3a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:04.136847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:04.137499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.137785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.138064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.163727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513b8d0-d2af-4520-8662-adb2f2525b3f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:04.170771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:04.174411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:04.178271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.178271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.178271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.178522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04dec3-280e-4ef2-b384-20f6e9cd5464 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:04.178750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:04.182757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:04.200497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 849/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:04.223360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.225111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.226163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.392256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:04.395023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:04.555318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 850/1701] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:18:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:04.557705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:04.560424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:04.657581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 852/1702] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:04 2022] POST /identity/v3/projects => generated 401 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:04.666292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:04.900609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd283f4-eaf3-4c66-8ee5-ca6128917341 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:04.937753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d498-7e0e-4892-8ec2-4a4b7da9daad admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:04.946222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:04.946978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:04.947318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:04.951015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:04.951015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:04.951257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.040844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.041481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.042706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.043428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.106809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 853/1703] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:04 2022] POST /identity/v3/users => generated 301 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:05.115388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:05.167388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e401b8-7b06-4296-a1e4-6d74cf05031e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.190566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.195473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.197928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.198750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.204406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.211930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.255194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 854/1704] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:05.255194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:05.262024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:05.307259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:05.315387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.317775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.383297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 851/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 824 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:05.383297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:05.406716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:05.456032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79d85-6232-485c-9da9-6d30e2393907 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.457427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e1f55-85c7-4c1f-a528-e13e1ca4b2fb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.463568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.464251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.464537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.464817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.479096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.479818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.480147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.480408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.481166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.482830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.519672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 852/1706] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:05.525346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:05.542323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:05.577438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673928a-ae0c-4809-bbea-7c60404e12c6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.582673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.586404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.599896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.600724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.601073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.601414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] PATH_INFO: `/v3/projects/ed3290175a5a47f2be29d8a614ac2ea1` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.604685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3290175a5a47f2be29d8a614ac2ea1)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.605239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 855/1707] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:18:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:18:05.606277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:05.606614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.651269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdf98-f659-4aae-b9c2-48c3a4580e25 service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:05.713140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:05.713949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.714243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.714536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] PATH_INFO: `/v3/projects/30cc8e34774147619330d5403935ca9b/users/b567acbb43634220abd19b2614c38c6e/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.743708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:05.793753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cc8e34774147619330d5403935ca9b, user_id=b567acbb43634220abd19b2614c38c6e, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:05.800498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb73f-0507-4b03-8d3a-b78f9c87c4d6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:05.929999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 856/1708] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:05 2022] PUT /identity/v3/projects/30cc8e34774147619330d5403935ca9b/users/b567acbb43634220abd19b2614c38c6e/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:05.946882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3290175a5a47f2be29d8a614ac2ea1', 'request_id': 'req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:05.948963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:05.949915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:05.950998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:05.972596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3290175a5a47f2be29d8a614ac2ea1', 'request_id': 'req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.081707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3290175a5a47f2be29d8a614ac2ea1', 'request_id': 'req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.115566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] MFA Rules not processed for user `b567acbb43634220abd19b2614c38c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:06.121282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:06.136781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] The token cache is being invalidate because project ed3290175a5a47f2be29d8a614ac2ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:06.137367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.139781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7fc1ed3f-61e9-4f71-a75a-b31bd7ce68f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.145730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 853/1709] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:05 2022] DELETE /identity/v3/projects/ed3290175a5a47f2be29d8a614ac2ea1 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:06.153834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:06.154787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:06.156349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:06.250857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:06.253544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:06.284694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:06.518303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 857/1710] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:06.519658 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:06.524601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:06.533253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 854/1711] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:06.534142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:06.541110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:06.559552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e239f1-3dda-4e1b-b414-fd567b06d171 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:06.568702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:06.577018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:06.577648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:06.578450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] PATH_INFO: `/v3/projects/985e0d47f2024a218fb1d186958bfc05` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:06.580900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] RBAC: Authorizing `identity:delete_project(project_id=985e0d47f2024a218fb1d186958bfc05)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:06.584569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:06.588091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecc394-7a92-432b-b8c4-6caa1483f922 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:06.623706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:06.624985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:06.625457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:06.625911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] PATH_INFO: `/v3/users/db900a1b198d4266a3997938f8927b33` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:06.632794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db900a1b198d4266a3997938f8927b33)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:06.635703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:06.859437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985e0d47f2024a218fb1d186958bfc05', 'request_id': 'req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.888421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985e0d47f2024a218fb1d186958bfc05', 'request_id': 'req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.949298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db900a1b198d4266a3997938f8927b33'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.972554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db900a1b198d4266a3997938f8927b33'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:06.973838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db900a1b198d4266a3997938f8927b33'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.001995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985e0d47f2024a218fb1d186958bfc05', 'request_id': 'req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.035667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db900a1b198d4266a3997938f8927b33'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.049841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] The token cache is being invalidate because project 985e0d47f2024a218fb1d186958bfc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:07.050786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.052889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.060024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 858/1712] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:06 2022] DELETE /identity/v3/projects/985e0d47f2024a218fb1d186958bfc05 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:07.062753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:07.074211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:07.127472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3afcbd79-d146-4699-9950-f5e6786b2f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db900a1b198d4266a3997938f8927b33'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.169328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 855/1713] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:06 2022] DELETE /identity/v3/users/db900a1b198d4266a3997938f8927b33 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:07.174933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:07.178282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:07.179688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:07.223087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:07.267097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:07.273038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:07.428375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c4ab6-e4aa-4b5e-b397-0f8250b4adde admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:07.514871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 856/1714] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:07.516376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:07.519770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:07.554233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97671034-7c00-46f0-b53a-c321396e0bf8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:07.570688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:07.572679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:07.574349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:07.574723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] PATH_INFO: `/v3/users/61ba0b403f4949589c28f2447abad649` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:07.577578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ba0b403f4949589c28f2447abad649)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:07.580994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:07.640525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:07.646218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:07.646728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:07.647150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:07.651308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:07.656403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79289bf-a13b-44df-abda-3a103ff15412 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:07.823509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:07.836065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 859/1715] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:07 2022] POST /identity/v3/projects => generated 401 bytes in 764 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:07.836065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a04f1-30d5-497d-8435-ed45a2b931db None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:07.836065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a04f1-30d5-497d-8435-ed45a2b931db None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:07.836065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a04f1-30d5-497d-8435-ed45a2b931db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:07.893276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-942a04f1-30d5-497d-8435-ed45a2b931db None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:07.900327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-942a04f1-30d5-497d-8435-ed45a2b931db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:07.928553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ba0b403f4949589c28f2447abad649'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.929578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:07.949517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ba0b403f4949589c28f2447abad649'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:07.951812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ba0b403f4949589c28f2447abad649'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:08.028063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ba0b403f4949589c28f2447abad649'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:08.112667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 860/1716] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:08.150090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:08.151448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:08.152223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:08.208563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:08.214285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:08.326206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ba0b403f4949589c28f2447abad649'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:08.341772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 857/1717] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:07 2022] DELETE /identity/v3/users/61ba0b403f4949589c28f2447abad649 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:08.343038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:08.347510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:08.418892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 861/1718] 10.222.0.58 () {58 vars in 1015 bytes} [Thu Aug 4 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:08.421407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:08.428712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:08.474772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9915020-4813-4100-b114-b4808e8c0e92 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:08.625487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09873-8c53-4b58-9289-ee1c73306e9b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:08.638776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:08.639535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:08.639891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:08.640286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:08.641906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:08.642430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:08.662931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d0914-e57d-4bad-8501-88132e61f521 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:08.711413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:08.712576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 858/1719] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:08.717079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:08.717432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:08.717725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:08.719337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1ebd-9dae-486f-87c4-3dc893fe74db None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:08.719656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1ebd-9dae-486f-87c4-3dc893fe74db None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:08.720823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:08.722917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:08.725701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1ebd-9dae-486f-87c4-3dc893fe74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:08.762807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-feae1ebd-9dae-486f-87c4-3dc893fe74db None None] MFA Rules not processed for user `071141217ce84c2aac232628ff5d0de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:08.766173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-feae1ebd-9dae-486f-87c4-3dc893fe74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:08.924109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 862/1720] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:08 2022] POST /identity/v3/users => generated 307 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:08.929886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:08.936780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:08.976214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 859/1721] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:08.977858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:08.978602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:08.979165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.071304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] MFA Rules not processed for user `089d2e686b2245dab52ff78ddfa8cb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:09.071304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:09.078081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed769dc6-4996-438b-a782-8b25ae183b44 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.086930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.088612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.116114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.117407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.165609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:09.167652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:09.185683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 863/1722] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:09.186949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.202840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d514b4-4ca3-4084-ad5a-d141f239bfa9 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.228644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.230039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.230575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.231074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.232041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:09.234469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:09.302234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 860/1723] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:09.304811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.348323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67bee-dcc9-4ff3-9a6d-569f7cb6be63 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.379881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.381422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.382447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.382947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.437878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:09.447743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 864/1724] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:09 2022] POST /identity/v3/projects => generated 369 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:09.451952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.457233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:09.526540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 861/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:09.532560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.605267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240263da-9360-4a28-a6f5-63080af96103 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.731769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d694b1-846c-45e7-8abe-953618e6b297 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.774602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.791616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.793047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.793731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.795354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:09.811670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:09.819881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.820872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.821155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.821618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.822396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:09.827439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:09.882688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 865/1726] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:09.889950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:09.941311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafc94-9c2c-4a91-950a-71db672464bb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:09.973706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:09.973964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:09.975464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:09.976509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:09.981641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] PATH_INFO: `/v3/projects/3aead5acc7824a119ec6abda05b15aee/users/340a67cc26c64f6e80d74a80e9f4f5b4/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:09.981987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 862/1727] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:09 2022] POST /identity/v3/users => generated 285 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:09.987215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.002963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216b24-90de-4bb7-9f31-08f6cc0ece44 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.009371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.010420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.011529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.012083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.013061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.015075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.031188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 863/1728] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:10.032572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.036618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aead5acc7824a119ec6abda05b15aee, user_id=340a67cc26c64f6e80d74a80e9f4f5b4, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.041394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.045288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eff1b-4a1f-4145-afb7-66968a001e98 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.051885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.052927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.053559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.054652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.055769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.057699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.063275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:10.080059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 864/1729] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:10.081364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.094148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a25b-5fc7-4fba-852a-51d918ef234f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.107402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.107402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.107402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.107402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] PATH_INFO: `/v3/projects/f90822ca40f640e7b39c63f9d5250c04/users/35b2b449f62242c5b3024468658340c3/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.128225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90822ca40f640e7b39c63f9d5250c04, user_id=35b2b449f62242c5b3024468658340c3, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.133706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305bf0f-f634-446d-9755-a57d84b88fc9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.187545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 866/1730] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:09 2022] PUT /identity/v3/projects/3aead5acc7824a119ec6abda05b15aee/users/340a67cc26c64f6e80d74a80e9f4f5b4/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:10.188602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.250437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 865/1731] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:10 2022] PUT /identity/v3/projects/f90822ca40f640e7b39c63f9d5250c04/users/35b2b449f62242c5b3024468658340c3/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:10.252350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.252636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.252879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.320610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] MFA Rules not processed for user `35b2b449f62242c5b3024468658340c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:10.325540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:10.381583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df365-9421-4434-922e-6db39777b11b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.568994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.575680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.575680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.575680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.575680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.576938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.626606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 866/1732] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:10.627796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.661251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 867/1733] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:10.665467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.667569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790301c5-9f41-4e18-8a55-2028a26bba9e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.686588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.687275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.687557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.687891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.692897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.695968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.742088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d755f68-c6cf-4edd-be95-472b21f5b72f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:10.761342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:10.762075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.762361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.762990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] PATH_INFO: `/v3/projects/3aead5acc7824a119ec6abda05b15aee/users/340a67cc26c64f6e80d74a80e9f4f5b4/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.765558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aead5acc7824a119ec6abda05b15aee, user_id=340a67cc26c64f6e80d74a80e9f4f5b4, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:10.781491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3b30-ed65-460e-b57d-edacb7f7e350 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:10.801093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 868/1734] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:10 2022] PUT /identity/v3/projects/3aead5acc7824a119ec6abda05b15aee/users/340a67cc26c64f6e80d74a80e9f4f5b4/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:10.817587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:10.820086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:10.822369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:10.870072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 867/1735] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:10 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:10.872839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:10.961393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] MFA Rules not processed for user `340a67cc26c64f6e80d74a80e9f4f5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:10.963009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:11.076978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6bf5-67b1-483b-9002-0b8f39859922 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:11.102743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:11.103709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:11.104233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:11.104728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:11.105606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:11.109118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:11.217875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 869/1736] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:11.220109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:11.226736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:11.262734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 868/1737] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:10 2022] POST /identity/v3/users => generated 290 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:11.272120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:11.279392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:11.285751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:11.307237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3c51-0b4d-425e-be2b-9fe4ff9d3aa5 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:11.324155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:11.325262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:11.325836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:11.326304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] PATH_INFO: `/v3/projects/700a4fae456f4ea7b206b67d4522c8a8` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:11.329706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700a4fae456f4ea7b206b67d4522c8a8)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:11.337288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:11.539443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5872c-b1cc-4acd-9d83-c60063b78f46 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:11.556586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:11.557363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:11.562106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:11.562106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:11.592037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:11.596616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:11.638810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 869/1738] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:11.644674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:11.687199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f411e4f-91a4-496e-946d-90f7a3e69e29 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:11.688971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700a4fae456f4ea7b206b67d4522c8a8', 'request_id': 'req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:11.763285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700a4fae456f4ea7b206b67d4522c8a8', 'request_id': 'req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:11.790105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:11.883803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:11.884756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:11.885047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:11.885327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:11.886051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:11.888031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:11.892123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700a4fae456f4ea7b206b67d4522c8a8', 'request_id': 'req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:11.929549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 870/1739] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:11.929913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] The token cache is being invalidate because project 700a4fae456f4ea7b206b67d4522c8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:11.930591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:11.937407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:11.937592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:11.937691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:11.948423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 870/1740] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:11 2022] DELETE /identity/v3/projects/700a4fae456f4ea7b206b67d4522c8a8 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:11.960604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:11.980781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:11.985843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfe06f-ba41-416d-a174-c8684b345f91 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:11.991644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:11.992733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.005541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.010513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] PATH_INFO: `/v3/projects/376e908cc4014350a0cc3674396224d1` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.013981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=376e908cc4014350a0cc3674396224d1)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:12.024056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:12.066031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f44a-1e17-44a3-a63f-5a760d7c2526 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:12.105027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:12.106213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.106723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.109777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] PATH_INFO: `/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343/users/de99a893c9174f07b7c91e4985bfd025/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.239065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376e908cc4014350a0cc3674396224d1', 'request_id': 'req-4060d45a-36ee-4eac-aaf7-5499978ddc5f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:12.248546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a40e19a11eb4bfcafaaf6e3cbcdd343, user_id=de99a893c9174f07b7c91e4985bfd025, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:12.262999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0582-dc19-425c-9cb0-be1b1c6ce5d6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:12.264880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376e908cc4014350a0cc3674396224d1', 'request_id': 'req-4060d45a-36ee-4eac-aaf7-5499978ddc5f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:12.305701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.333686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 871/1741] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:11 2022] PUT /identity/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343/users/de99a893c9174f07b7c91e4985bfd025/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:12.338055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.338055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.338055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.384184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376e908cc4014350a0cc3674396224d1', 'request_id': 'req-4060d45a-36ee-4eac-aaf7-5499978ddc5f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:12.398293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:12.403622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.406767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] The token cache is being invalidate because project 376e908cc4014350a0cc3674396224d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:12.407072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:12.410386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:12.418502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 871/1742] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:11 2022] DELETE /identity/v3/projects/376e908cc4014350a0cc3674396224d1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:12.419465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:12.425674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.534326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:12.627378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060d45a-36ee-4eac-aaf7-5499978ddc5f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:12.627691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 872/1743] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:12.628867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:12.630422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.655168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b2eb8-c7a7-419e-a14e-1fc9f463f350 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:12.660048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:12.661831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.661831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.661831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.662532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:12.665001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e2e9-8110-495b-9180-5d5517eac459 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:12.680222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 873/1744] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:12.682198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4392d-3713-4d59-b0c1-b9b967915fb0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.682867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4392d-3713-4d59-b0c1-b9b967915fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.683330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4392d-3713-4d59-b0c1-b9b967915fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.752836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c2a4392d-3713-4d59-b0c1-b9b967915fb0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:12.755521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c2a4392d-3713-4d59-b0c1-b9b967915fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.772577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 874/1745] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:12.774755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c52e-d975-4f26-b6e0-cca73a661b9d None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.775389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c52e-d975-4f26-b6e0-cca73a661b9d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.776501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88c52e-d975-4f26-b6e0-cca73a661b9d None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.779491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 875/1746] 10.222.0.36 () {54 vars in 912 bytes} [Thu Aug 4 05:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:12.781350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.781943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.782178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:12.782783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.783626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.785165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.785638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.792242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.832677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:12.837877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:12.857433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 876/1747] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:12.861559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:12.893836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b81b3-0eab-4dd7-a751-62f3c2f77bd9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:12.904903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:12.905628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.905971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.906265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] PATH_INFO: `/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343/users/de99a893c9174f07b7c91e4985bfd025/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.912561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a40e19a11eb4bfcafaaf6e3cbcdd343, user_id=de99a893c9174f07b7c91e4985bfd025, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:12.917656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bafb0-baf0-4afd-b155-a5c0d13329bb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:12.946739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:12.948722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85744224-7698-43c1-9e41-9845cc7c266f service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:12.949069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 877/1748] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:12 2022] PUT /identity/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343/users/de99a893c9174f07b7c91e4985bfd025/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:12.954178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.955695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.956314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:12.972493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 872/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:12.989549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cdba9-cebd-44fe-9197-f085d787390e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:12.992581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cdba9-cebd-44fe-9197-f085d787390e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:12.994234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cdba9-cebd-44fe-9197-f085d787390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.045764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:13.050206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:13.054605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-434cdba9-cebd-44fe-9197-f085d787390e None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:13.056785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-434cdba9-cebd-44fe-9197-f085d787390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:13.237535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:13.262672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 878/1750] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:13.265098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:13.278515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 873/1751] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:18:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:13.284028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.284896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.285943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.304967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783bfd-b08e-4aba-add7-f97801cdfbd0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:13.311282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:13.334471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.334471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.334471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.357013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:13.357497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:13.360466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:13.372585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:13.432836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] MFA Rules not processed for user `de99a893c9174f07b7c91e4985bfd025`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:13.438049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:13.478291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 879/1752] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:13.480293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:13.541550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde9a5-3207-4f2f-b2fb-022605c9a62d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:13.561407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:13.562387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.562915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.563933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.566498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:13.567132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:13.570267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:13.644425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 880/1753] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:13.659007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 874/1754] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:13.662291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:13.662703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:13.665200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:13.680845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c188-bfd4-4872-aef2-09af2becbbd4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:13.685478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408024f1-9dd3-4ea6-b7c0-82fd2edd2aca None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:13.685839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:13.686725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.687117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.687513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.721483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:13.723313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af585b-ddae-49f2-b6b5-6e4f5d5a47fa service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:13.726927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:13.728958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.736910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.736910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.736910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:13.736910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:13.742138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 881/1755] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:13.762261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.763009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.763481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.765303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 882/1756] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:18:13 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:13.766273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:13.793066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:13.838877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc386-e3a6-4c8f-8bb8-bc8fbad8a34f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:13.846288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:13.847028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:13.847422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:13.847752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] PATH_INFO: `/v3/users/7bcdc8e68aa247f7b0cbd41a2ca61967` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:13.849348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcdc8e68aa247f7b0cbd41a2ca61967)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:13.853187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:13.919780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 875/1757] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:13 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:13.921569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:14.149131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d59f6-4bd3-4769-ba6a-8a05fb04f739 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:14.149812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcdc8e68aa247f7b0cbd41a2ca61967'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:14.171571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcdc8e68aa247f7b0cbd41a2ca61967'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:14.172855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:14.173538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcdc8e68aa247f7b0cbd41a2ca61967'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:14.176989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcdc8e68aa247f7b0cbd41a2ca61967'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:14.181575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:14.182395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:14.182831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:14.185033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:14.189163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:14.238820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ceaf154-9f8e-42e0-abde-7dbf91a4e198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcdc8e68aa247f7b0cbd41a2ca61967'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:14.258545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:14.319971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 876/1758] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:13 2022] POST /identity/v3/projects => generated 365 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:14.320822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:14.323825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:14.346068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 883/1759] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:13 2022] DELETE /identity/v3/users/7bcdc8e68aa247f7b0cbd41a2ca61967 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:14.347822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:14.348136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:14.348417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:14.415232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:14.425193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:14.540274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840875-8e82-4bae-b01b-eafcaf38b069 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:14.543469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:14.690857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 884/1760] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:18:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:14.692291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:14.696643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:14.727671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:14.729128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:14.729671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:14.730135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:14.735129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:14.906396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d151c-7253-428d-b1f4-08c89c36f6ad None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:14.912281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:14.913576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:14.913988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:14.914446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:14.915175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:14.917399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a740540-bfa1-4182-9a6f-568443223c09 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:14.946951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:14.950276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:14.984053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 877/1761] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:14.995356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:14.996644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.026477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 885/1762] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:14 2022] POST /identity/v3/users => generated 283 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:15.026477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.026477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.026477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.038502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134569b8-2b4e-4e42-bade-a629bcaaf6e4 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.045723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.046669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.047184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.047765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.049007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.052277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.062114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:15.063940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.076359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 886/1763] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:15.077238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.092482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c055a6-97ee-4746-91ed-7bb227e8eec4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.101349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.102798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.103275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.103566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.104738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.106925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.129999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 887/1764] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:15.134459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.160395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29eadbd-c3b2-4cbd-ac0c-0dc34819fb04 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.160395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.160395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.160395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.160931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.160931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.162616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.186941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 888/1765] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:15.186941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.188721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.282500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 878/1766] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:14 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:15.285121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.294402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b881-1c9d-4ffb-9967-7eca1e3f03a8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.301082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.302083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.304886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.306002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.333595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.337321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.352635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 889/1767] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:15.354507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.356769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.361816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b4b7-51b6-43bc-ac1b-b19c88fa8237 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.378326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8589f32-db2e-4c4b-bd3b-db9854581a75 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.384456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.385054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.385761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.386326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.386447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.386829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.387336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] PATH_INFO: `/v3/projects/cd7ee5ff5bd94397a9463a0fe5ee088c/users/d2988958f30d406c85b3ed510a7ec5d5/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.387575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.390656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.440830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:15.451896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7ee5ff5bd94397a9463a0fe5ee088c, user_id=d2988958f30d406c85b3ed510a7ec5d5, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.456444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.500106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.502887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.521944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 890/1768] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:15.533451 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.549844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d8287-9444-4f2f-a8a1-6833c2dd1b4a service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.559300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.559726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.560053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.560340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.561066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.590796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.648501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 891/1769] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:15.648501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.654939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:15.745708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 879/1770] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:15 2022] PUT /identity/v3/projects/cd7ee5ff5bd94397a9463a0fe5ee088c/users/d2988958f30d406c85b3ed510a7ec5d5/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:15.747142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:15.764518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff859-9e14-4e24-b889-f1732d69bafc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.785248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:15.926401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11ef3-0cfa-4b5a-9ea4-648ecdc49555 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:15.942179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.942828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:15.943122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:15.946604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:15.947254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:15.949079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85387a0a-5c8c-4d7d-9d9f-306e0dc88702 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:15.998674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:15.999497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.000111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.004584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.019560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 880/1771] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:16.020402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.020584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.020584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.020584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.033569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.059505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 892/1772] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:16.060420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:16.072562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] MFA Rules not processed for user `d2988958f30d406c85b3ed510a7ec5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:16.074002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:16.093289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354d77-bdfa-4408-862b-4b36c2892f8e service nova] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:16.098984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:16.099761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.100147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.100500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] PATH_INFO: `/v3/projects/d5ce6b5acd154d9794bd038547067a33/users/1d33284c39fd43be8d3e1b3edc671cf6/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.136548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ce6b5acd154d9794bd038547067a33, user_id=1d33284c39fd43be8d3e1b3edc671cf6, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.139352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145242b-fef8-47d3-bdd8-1bb19d6ecc47 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.277683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 881/1773] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:16.278973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:16.293255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c0a0-63b8-4507-8fc3-f78841570d81 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:16.299929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:16.301268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.301940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.308434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.308434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.308434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.325120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 893/1774] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:16 2022] PUT /identity/v3/projects/d5ce6b5acd154d9794bd038547067a33/users/1d33284c39fd43be8d3e1b3edc671cf6/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:16.326859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.327151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.327428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.425761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] MFA Rules not processed for user `1d33284c39fd43be8d3e1b3edc671cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:16.427170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:16.462771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 882/1775] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:16 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:16.471506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:16.697139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 894/1776] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:16.707726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:16.735886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974306fd-a6af-44c3-9ca7-74a7d20e6059 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:16.742766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:16.743874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.744301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.744717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.746352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.749361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.827994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be996b32-3af0-41f9-9221-003eff62d939 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:16.834328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:16.835616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.836192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.836192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.836890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.839414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.882060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 883/1777] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:16 2022] POST /identity/v3/users => generated 288 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:16.883164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:16.930326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a807e-9a59-425e-ac1b-abb043b2b372 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:16.932094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:16.958298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:16.959052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:16.959407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:16.959858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:16.962920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:16.965077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:16.999536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 884/1778] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:17.007761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:17.008976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 895/1779] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:16 2022] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:17.013858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:17.064958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065753d-8672-46e8-b74f-c6f35efe87ed admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:17.103485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:17.267231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1bf8d-29a1-494e-9fac-af723c221609 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:17.273409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:17.285448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:17.285448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:17.285448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:17.285448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:17.285448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:17.326353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:17.328574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:17.330379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:17.349488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] PATH_INFO: `/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a/users/f0a0afa09c7e418c9a4083c42e554a92/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:17.375985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 896/1780] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:17 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:17.384577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:17.452271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c196e-bddf-43c9-ad75-328ff8369158 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:17.462903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:17.464012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:17.464434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:17.464677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:17.465387 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:17.467177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:17.480014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3098c6494f7d49cf9b5ad9df68ed8c6a, user_id=f0a0afa09c7e418c9a4083c42e554a92, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:17.495854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:17.562477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 897/1781] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:17.563679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:17.599450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba13d-a4a0-479f-a193-ac7a8da81e77 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:17.630106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:17.631185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:17.632285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:17.632690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] PATH_INFO: `/v3/projects/db2a5762738d4b168b9ed21a66542865/users/986365a47a5b4633917484fe2a302b48/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:17.716889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 885/1782] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:17 2022] PUT /identity/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a/users/f0a0afa09c7e418c9a4083c42e554a92/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:17.726360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2a5762738d4b168b9ed21a66542865, user_id=986365a47a5b4633917484fe2a302b48, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:17.729642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:17.730256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:17.827320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 898/1783] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:17 2022] PUT /identity/v3/projects/db2a5762738d4b168b9ed21a66542865/users/986365a47a5b4633917484fe2a302b48/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:17.828362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:18.055789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750a38-bb32-48f1-8521-ba8e242c6ce0 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:18.080211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:18.154283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951bfd-0e38-48fb-91ec-4e3f78626499 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:18.175761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:18.177038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.178178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.179199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.180513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:18.187860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:18.257000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 899/1784] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:18.261596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:18.269877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:18.321270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f1c7-e8b8-4f35-b45f-f7a79f6483e2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:18.349907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:18.354023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.354554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.359875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.359875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:18.360273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:18.360273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.360584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.362961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] PATH_INFO: `/v3/projects/3ebd2b0b5640459d9f1ba9a454b98b66` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.363172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebd2b0b5640459d9f1ba9a454b98b66)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:18.370789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:18.370958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:18.401642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 886/1785] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 671 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:18.402291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:18.426533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a943f-f76b-4801-a0f7-fb0fff1e6183 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:18.445407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:18.446101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.446390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.446670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] PATH_INFO: `/v3/projects/db2a5762738d4b168b9ed21a66542865/users/986365a47a5b4633917484fe2a302b48/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.461095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2a5762738d4b168b9ed21a66542865, user_id=986365a47a5b4633917484fe2a302b48, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:18.466517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:18.524094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 887/1786] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:18 2022] PUT /identity/v3/projects/db2a5762738d4b168b9ed21a66542865/users/986365a47a5b4633917484fe2a302b48/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:18.526642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:18.545756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebd2b0b5640459d9f1ba9a454b98b66', 'request_id': 'req-68a431c0-f894-4c30-ae55-a5d9b223fdc6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:18.549721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:18.587251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebd2b0b5640459d9f1ba9a454b98b66', 'request_id': 'req-68a431c0-f894-4c30-ae55-a5d9b223fdc6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:18.728862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a7b7-0bf9-45e0-9407-1c02d8dc8c2b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:18.782219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebd2b0b5640459d9f1ba9a454b98b66', 'request_id': 'req-68a431c0-f894-4c30-ae55-a5d9b223fdc6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:18.821918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] The token cache is being invalidate because project 3ebd2b0b5640459d9f1ba9a454b98b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:18.822594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:18.823452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-68a431c0-f894-4c30-ae55-a5d9b223fdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:18.826761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 900/1787] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:18 2022] DELETE /identity/v3/projects/3ebd2b0b5640459d9f1ba9a454b98b66 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:18.830393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce25d9-9d77-44f2-8ac8-c7c2b308d76f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.830393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce25d9-9d77-44f2-8ac8-c7c2b308d76f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.830393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce25d9-9d77-44f2-8ac8-c7c2b308d76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.900031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:18.901778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:18.902838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:18.904312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] PATH_INFO: `/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a/users/f0a0afa09c7e418c9a4083c42e554a92/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:18.909335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3098c6494f7d49cf9b5ad9df68ed8c6a, user_id=f0a0afa09c7e418c9a4083c42e554a92, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:18.916617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:18.930815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-89ce25d9-9d77-44f2-8ac8-c7c2b308d76f None None] MFA Rules not processed for user `986365a47a5b4633917484fe2a302b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:18.932434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-89ce25d9-9d77-44f2-8ac8-c7c2b308d76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:18.949096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 888/1788] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:18 2022] PUT /identity/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a/users/f0a0afa09c7e418c9a4083c42e554a92/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:18.951027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:18.960253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.124381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe7a7e-2119-41fb-a52b-ea642ee7828e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:19.128982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 901/1789] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:19.131394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0766-afc7-401e-a022-6effd7275182 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.132090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0766-afc7-401e-a022-6effd7275182 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.132624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0766-afc7-401e-a022-6effd7275182 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.148991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 902/1790] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:18:19 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:19.148991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.149280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.151316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:19.151708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.152369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.152809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.153257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] PATH_INFO: `/v3/users/fea7d36793d8462b99fbe908a70a5289` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.157191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea7d36793d8462b99fbe908a70a5289)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:19.160627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:19.227742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] MFA Rules not processed for user `f0a0afa09c7e418c9a4083c42e554a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:19.229682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.306238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.364994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 903/1791] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:19.367579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:19.369968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.422071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.427227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea7d36793d8462b99fbe908a70a5289'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:19.440353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea7d36793d8462b99fbe908a70a5289'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:19.441605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea7d36793d8462b99fbe908a70a5289'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:19.455175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea7d36793d8462b99fbe908a70a5289'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:19.503627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242761a-c4e8-44e4-98e6-684970ff8e4d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:19.508657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:19.509400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.509686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.509968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.512047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.529590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:19.531174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809066d9-f0d3-4b3c-935c-20225423b58d service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:19.536222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea7d36793d8462b99fbe908a70a5289'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:19.547660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 904/1793] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:19.548226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 889/1793] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:18 2022] DELETE /identity/v3/users/fea7d36793d8462b99fbe908a70a5289 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:19.548416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.548416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.548416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.576415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:19.576415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.726212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 905/1794] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:18:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:19.751609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:19.753774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.796484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:19.798191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:19.808841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90ca53-57ff-4f41-acfe-63cef918aa5f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:19.827943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:19.828671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.828955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.829402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.858995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:19.860662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:19.904503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 890/1795] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:19.970779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fae886-6cbc-4aca-afce-4c2ee4c15db3 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:19.980768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:19.981624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:19.981972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:19.986172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:19.986172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:20.047747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:20.169880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:20.172533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:20.200248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 906/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:20.399583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:20.401481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:20.627703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72a69-dc47-4caf-85e0-4846991f71ff service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:20.640863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:20.641898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:20.642191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:20.642549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] PATH_INFO: `/v3/projects/8855d9adea20479190372db63a344ea6` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:20.649004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8855d9adea20479190372db63a344ea6)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:20.652277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:20.728293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:20.729860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:20.766788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850109-4831-4500-8ca2-7e04e56d0c1b service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:20.777099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:20.780303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:20.781566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:20.781566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:20.791724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:20.964656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8855d9adea20479190372db63a344ea6', 'request_id': 'req-44177051-c2d5-4292-8f55-116bf28e9381'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:20.981155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8855d9adea20479190372db63a344ea6', 'request_id': 'req-44177051-c2d5-4292-8f55-116bf28e9381'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:21.035395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:21.040041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63e519-56bf-421e-b870-847525ff36a3 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:21.091072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 907/1797] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:21.109537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8855d9adea20479190372db63a344ea6', 'request_id': 'req-44177051-c2d5-4292-8f55-116bf28e9381'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:21.132301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] The token cache is being invalidate because project 8855d9adea20479190372db63a344ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:21.134382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:21.135661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-44177051-c2d5-4292-8f55-116bf28e9381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:21.138840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 891/1798] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:20 2022] DELETE /identity/v3/projects/8855d9adea20479190372db63a344ea6 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:21.143788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:21.144286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:21.144574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:21.211255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:21.213135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:21.331193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 908/1799] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:21.341019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:21.341354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:21.341591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:21.370128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:21.371623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:21.383960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 892/1800] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:21.385775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:21.404509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058f6d0-6e51-4d02-b68b-28f691638762 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:21.429751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:21.430486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:21.431104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:21.431427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:21.432488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:21.432838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:21.434737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:21.464746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 909/1801] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:21.470145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:21.494352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fc67c-4e8b-4c30-8883-0688701d5dfb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:21.507932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:21.508715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:21.509459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:21.511748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:21.512721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:21.515722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:21.648908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 893/1802] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:21 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:21.655410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:21.678401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3642c-875d-4c41-b0d2-98b7c47a6ec8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:21.870007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:21.909472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:21.910291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:21.911131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:21.915184 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:21.916176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:21.918993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:22.054714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 910/1803] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:21 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:22.059440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:22.078074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe809f-f797-425c-88ac-683c94bfcfcc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:22.094586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:22.095334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.095936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.096521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.097809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:22.101361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:22.116640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:22.152266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 894/1804] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:22.153214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:22.172963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4babc5-b0bd-4f91-b068-69334882aa46 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:22.184077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:22.186258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.188070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.188540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.189502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:22.191279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:22.207422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 911/1805] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:22.208851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:22.228270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d42cc-a543-4a87-9b6c-91ce294d1459 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:22.241476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:22.241476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.241476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.241476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] PATH_INFO: `/v3/projects/b80944691aef45f4b662071bffd90174/users/7274abb3d0694df98bd8a9e04fe36231/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.253431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80944691aef45f4b662071bffd90174, user_id=7274abb3d0694df98bd8a9e04fe36231, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:22.256627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb645e5-b65f-4d7f-bb99-ccd62e688c84 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:22.311028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:22.314426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:22.334867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc4f69-cbab-4ac6-808f-d93b896d74a2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:22.341055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:22.341729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.342562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.342562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] PATH_INFO: `/v3/users/1d33284c39fd43be8d3e1b3edc671cf6` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.344154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d33284c39fd43be8d3e1b3edc671cf6)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:22.364900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:22.675998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 895/1806] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:22 2022] PUT /identity/v3/projects/b80944691aef45f4b662071bffd90174/users/7274abb3d0694df98bd8a9e04fe36231/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:22.688014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.688558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.688908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.735223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] MFA Rules not processed for user `7274abb3d0694df98bd8a9e04fe36231`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:22.736511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:22.820657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 896/1807] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:22.825417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:22.898392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d33284c39fd43be8d3e1b3edc671cf6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:22.909396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d33284c39fd43be8d3e1b3edc671cf6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:22.910166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d33284c39fd43be8d3e1b3edc671cf6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:22.911239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d33284c39fd43be8d3e1b3edc671cf6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:22.922173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd570a-7723-43a9-980d-8abd783cf36e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:22.936721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d33284c39fd43be8d3e1b3edc671cf6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:22.936902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:22.937615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:22.937891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:22.938178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:22.938863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:22.940933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeeb1f0-2e1b-42b4-a425-a9c1795f8367 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.048265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 912/1808] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:22 2022] DELETE /identity/v3/users/1d33284c39fd43be8d3e1b3edc671cf6 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:23.050309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.052007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.107668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 897/1809] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:22 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:23.110397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.111163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.111644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.144383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:23.147682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.199846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c547-bbc2-466d-9a1d-952923f27207 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.284155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:23.304657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.305852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.306383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.306918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] PATH_INFO: `/v3/users/b567acbb43634220abd19b2614c38c6e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.308375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b567acbb43634220abd19b2614c38c6e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.310549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.311529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 898/1810] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:23.316042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.317619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.348414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf370a8-93b3-4683-b491-da567cc61227 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.363879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.364618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.364968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.365335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.366168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.368415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.467021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 899/1811] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:23 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:23.468743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.472538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.538602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b567acbb43634220abd19b2614c38c6e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.560275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b567acbb43634220abd19b2614c38c6e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.561473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b567acbb43634220abd19b2614c38c6e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.562583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b567acbb43634220abd19b2614c38c6e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.589572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b567acbb43634220abd19b2614c38c6e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.599641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acea3a8-3653-4e84-8e44-6bdb00c74249 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.610864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.610864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.610864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.610864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.611494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.621927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.623481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.634980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 900/1812] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:23.635944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.637358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.650103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4680-1e30-4488-bc09-78e8d66bd340 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.655192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.655818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.656131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.656407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.657154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.658789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.670568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 901/1813] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:23.671104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.673400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:23.690639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d950-a222-4da0-a8e8-2ab9831b21f4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.696175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.704352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.704352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.704352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] PATH_INFO: `/v3/users/35b2b449f62242c5b3024468658340c3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.704352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b2b449f62242c5b3024468658340c3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.704352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.780027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 913/1814] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:23 2022] DELETE /identity/v3/users/b567acbb43634220abd19b2614c38c6e => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:23.780728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:23.878416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b72751-ffa8-4718-9bad-2140d66b9da1 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:23.884861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:23.885562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:23.885846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:23.886124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] PATH_INFO: `/v3/projects/962a2d3803da4fedac4328979efe71d7/users/5ffe76c1c2894123b0988843b640008b/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:23.913578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=962a2d3803da4fedac4328979efe71d7, user_id=5ffe76c1c2894123b0988843b640008b, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:23.915674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acbacd-766f-4297-a23a-67581a2bf32a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:23.923387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b2b449f62242c5b3024468658340c3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.937883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b2b449f62242c5b3024468658340c3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.939361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b2b449f62242c5b3024468658340c3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:23.959186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b2b449f62242c5b3024468658340c3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.003546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 914/1815] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:23 2022] PUT /identity/v3/projects/962a2d3803da4fedac4328979efe71d7/users/5ffe76c1c2894123b0988843b640008b/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:24.005359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484e37-5228-4aff-a4ac-dbda50b1dd92 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.005819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484e37-5228-4aff-a4ac-dbda50b1dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.006295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484e37-5228-4aff-a4ac-dbda50b1dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.009496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b2b449f62242c5b3024468658340c3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.027373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 902/1816] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:23 2022] DELETE /identity/v3/users/35b2b449f62242c5b3024468658340c3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:24.030384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.032376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.046923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5f484e37-5228-4aff-a4ac-dbda50b1dd92 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:24.048428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5f484e37-5228-4aff-a4ac-dbda50b1dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.167149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc21d65-449d-4a8f-821e-445ebc2000a2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.174179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 915/1817] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:24.175888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.176173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.176458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.182856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.183338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.192634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.192634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.192634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.192634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.201786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:24.205982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 903/1818] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:24.206143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.206245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.206245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.216944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 916/1819] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:24.216944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.216944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.229306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bad7-517a-4b58-b716-b182e0a34878 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.243325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.244018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.244299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.244660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] PATH_INFO: `/v3/projects/d5ce6b5acd154d9794bd038547067a33` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.246008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ce6b5acd154d9794bd038547067a33)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.248127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.276594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f8aa-b791-40e3-a1c6-b858ee41051d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.280529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.281251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.281445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.281724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.301518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.303191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.315067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 904/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:24.315880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.326015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96087-79ab-467f-82fd-4ec4b7daedd1 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.331174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.331854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.332190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.332461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] PATH_INFO: `/v3/projects/962a2d3803da4fedac4328979efe71d7/users/5ffe76c1c2894123b0988843b640008b/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.334529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962a2d3803da4fedac4328979efe71d7, user_id=5ffe76c1c2894123b0988843b640008b, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.337361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.351418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 905/1821] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:24 2022] PUT /identity/v3/projects/962a2d3803da4fedac4328979efe71d7/users/5ffe76c1c2894123b0988843b640008b/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:24.352979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.361290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.367599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ce6b5acd154d9794bd038547067a33', 'request_id': 'req-4093b91b-d697-48ab-ab5e-ac900cdb85cf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.374329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ce6b5acd154d9794bd038547067a33', 'request_id': 'req-4093b91b-d697-48ab-ab5e-ac900cdb85cf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.414479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:24.428869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ce6b5acd154d9794bd038547067a33', 'request_id': 'req-4093b91b-d697-48ab-ab5e-ac900cdb85cf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.434645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8eaa-16b7-4fd1-bfa7-12a63f9acee3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.443070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] The token cache is being invalidate because project d5ce6b5acd154d9794bd038547067a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:24.443620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.444248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4093b91b-d697-48ab-ab5e-ac900cdb85cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.446147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 917/1822] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:24 2022] DELETE /identity/v3/projects/d5ce6b5acd154d9794bd038547067a33 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:24.447210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.447508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.447787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.480543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] MFA Rules not processed for user `5ffe76c1c2894123b0988843b640008b`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:24.481786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.504061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.504917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.505282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.505622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.508904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.576864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 918/1823] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:24.578266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.580156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.664818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.666417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.678220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 906/1824] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:24.679201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.680697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.680822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2098-cdf2-48dc-9baf-127ccdc1decf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.696901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.701154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.701154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.701154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] PATH_INFO: `/v3/users/986365a47a5b4633917484fe2a302b48` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.706466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=986365a47a5b4633917484fe2a302b48)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.708483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.763109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb454d-6b65-4e1b-a966-a434c812d211 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:24.767844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:24.770028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:24.770028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:24.770028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:24.772421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.872348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:24.873830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:24.884675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 907/1825] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:24.958785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:24.963452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:24.983261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986365a47a5b4633917484fe2a302b48'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.994618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986365a47a5b4633917484fe2a302b48'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:24.995816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986365a47a5b4633917484fe2a302b48'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.001062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986365a47a5b4633917484fe2a302b48'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.007394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1556bd-d9a3-4c79-87e1-5160c96a89b9 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:25.014417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986365a47a5b4633917484fe2a302b48'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.016655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:25.018721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:25.019892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:25.020610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] PATH_INFO: `/v3/projects/30cc8e34774147619330d5403935ca9b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:25.022323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cc8e34774147619330d5403935ca9b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:25.025109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:25.097403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 919/1826] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:24 2022] DELETE /identity/v3/users/986365a47a5b4633917484fe2a302b48 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:25.154571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cc8e34774147619330d5403935ca9b', 'request_id': 'req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.163145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cc8e34774147619330d5403935ca9b', 'request_id': 'req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.184314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:25.234720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cc8e34774147619330d5403935ca9b', 'request_id': 'req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.251313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] The token cache is being invalidate because project 30cc8e34774147619330d5403935ca9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:25.251624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.252344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.257439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 908/1827] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:24 2022] DELETE /identity/v3/projects/30cc8e34774147619330d5403935ca9b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:25.259006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:25.260687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:25.339322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1d76c-2e9f-4914-a80b-2e6c872f51fc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:25.405733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:25.413318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:25.414430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:25.414721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:25.415002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] PATH_INFO: `/v3/users/340a67cc26c64f6e80d74a80e9f4f5b4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:25.417171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340a67cc26c64f6e80d74a80e9f4f5b4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:25.420605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:25.667599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340a67cc26c64f6e80d74a80e9f4f5b4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.685167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340a67cc26c64f6e80d74a80e9f4f5b4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.686003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340a67cc26c64f6e80d74a80e9f4f5b4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.689186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340a67cc26c64f6e80d74a80e9f4f5b4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.710127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340a67cc26c64f6e80d74a80e9f4f5b4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:25.777967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:25.779436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:25.796855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce9139-e7ae-4463-b5ad-b1dcd769d83a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:25.807363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:25.808097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:25.808367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:25.808818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] PATH_INFO: `/v3/projects/db2a5762738d4b168b9ed21a66542865` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:25.809910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 920/1828] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:25 2022] DELETE /identity/v3/users/340a67cc26c64f6e80d74a80e9f4f5b4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:25.810417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2a5762738d4b168b9ed21a66542865)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:25.812577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:25.812823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:25.816929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:25.957346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893048d-2304-405e-ba5b-ef4858f2af30 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:25.982996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:25.983662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:25.984227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:25.984227 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] PATH_INFO: `/v3/projects/f90822ca40f640e7b39c63f9d5250c04` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:25.985646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90822ca40f640e7b39c63f9d5250c04)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:25.990652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:26.005729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2a5762738d4b168b9ed21a66542865', 'request_id': 'req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.020440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2a5762738d4b168b9ed21a66542865', 'request_id': 'req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.154738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2a5762738d4b168b9ed21a66542865', 'request_id': 'req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.181043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90822ca40f640e7b39c63f9d5250c04', 'request_id': 'req-f82b69d3-1b72-4ffc-b298-2cae56589714'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.189106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90822ca40f640e7b39c63f9d5250c04', 'request_id': 'req-f82b69d3-1b72-4ffc-b298-2cae56589714'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.201765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] The token cache is being invalidate because project db2a5762738d4b168b9ed21a66542865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:26.202191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.203578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aba27cd5-312a-4cd1-9e0f-ce7d24684f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.208033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 909/1829] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:25 2022] DELETE /identity/v3/projects/db2a5762738d4b168b9ed21a66542865 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:26.219709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7faf-29f9-4f88-8da9-e5bc1d65df69 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.220166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7faf-29f9-4f88-8da9-e5bc1d65df69 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.220635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7faf-29f9-4f88-8da9-e5bc1d65df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.248455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c30d7faf-29f9-4f88-8da9-e5bc1d65df69 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:26.250982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c30d7faf-29f9-4f88-8da9-e5bc1d65df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:26.251707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90822ca40f640e7b39c63f9d5250c04', 'request_id': 'req-f82b69d3-1b72-4ffc-b298-2cae56589714'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.269024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] The token cache is being invalidate because project f90822ca40f640e7b39c63f9d5250c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:26.269024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.271097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.276602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 921/1830] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:25 2022] DELETE /identity/v3/projects/f90822ca40f640e7b39c63f9d5250c04 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:26.282711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.292274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:26.356105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 910/1831] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:26.359498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.360036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.361217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.364762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b69d3-1b72-4ffc-b298-2cae56589714 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.370447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:26.371119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.371401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.371684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] PATH_INFO: `/v3/users/de99a893c9174f07b7c91e4985bfd025` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.373828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=de99a893c9174f07b7c91e4985bfd025)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:26.375781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:26.387958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:26.389367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:26.401487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 911/1832] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:26.405528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.416522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b8576-b7ff-4c10-9a78-c22147bb1f42 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.422956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:26.423720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.424180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.430236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.430236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:26.430236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:26.430236 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:26.443249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 912/1833] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:26.448470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.459010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855146e7-2cd7-4215-bd93-0cca34acdb7f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.463776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:26.464451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.464731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.465019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.465672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:26.467793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:26.620173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 913/1834] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:26 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:26.627535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.689778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de99a893c9174f07b7c91e4985bfd025'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.701244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cda05-2fb9-4aeb-93fb-7233d12fbdfc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.706322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:26.715304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.719376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.719376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.719376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:26.719376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:26.720420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de99a893c9174f07b7c91e4985bfd025'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.721989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de99a893c9174f07b7c91e4985bfd025'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.728379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de99a893c9174f07b7c91e4985bfd025'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.746552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de99a893c9174f07b7c91e4985bfd025'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:26.833145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 914/1835] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:26 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:26.835195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.837711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:26.863633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 922/1836] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:26 2022] DELETE /identity/v3/users/de99a893c9174f07b7c91e4985bfd025 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:26.863633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:26.867198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:26.933001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310efe8-2a85-476a-a6c4-9c8789106f17 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.977649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce70e70-3117-430c-a68c-76ab5d7ea1db admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:26.985862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:26.986692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:26.987274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:26.987655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:26.989446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:26.992083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.015954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:27.015954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.015954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.015954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.016535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 923/1837] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:27.016623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:27.019644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:27.030355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4185-e04f-4599-ab81-b5d5279722b4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:27.035594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:27.036358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.036766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.037058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.038145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:27.040002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.051189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 924/1838] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:27.056161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:27.066687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f63b-b61e-4a28-b6c1-27c6016830d2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:27.073318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:27.074291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.074651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.074996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] PATH_INFO: `/v3/projects/2ef7c9400b06496e9e539cbdac889bfb/users/b1eb121aea284330b3476b832fb1879a/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.093102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef7c9400b06496e9e539cbdac889bfb, user_id=b1eb121aea284330b3476b832fb1879a, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:27.096938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.112036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:27.116606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ded03-bb7f-4eae-8d46-9b8e3710aa84 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.128856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 915/1839] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:27.173106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 925/1840] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:27 2022] PUT /identity/v3/projects/2ef7c9400b06496e9e539cbdac889bfb/users/b1eb121aea284330b3476b832fb1879a/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:27.183455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.183742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.184067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.209960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:27.212516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:27.260684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] MFA Rules not processed for user `b1eb121aea284330b3476b832fb1879a`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:27.262476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:27.281755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:27.358210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd7ce-8106-40ea-8ff3-b5e974b42a49 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:27.374468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:27.375141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.375421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.375697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] PATH_INFO: `/v3/projects/3aead5acc7824a119ec6abda05b15aee` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.377891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aead5acc7824a119ec6abda05b15aee)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:27.379813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.451142 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 916/1841] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:27.456299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:27.471497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495035ca-6b9e-47a4-b22f-cde1f061350b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:27.479122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:27.480402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:27.480837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:27.481250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:27.482837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:27.485127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:27.964304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aead5acc7824a119ec6abda05b15aee', 'request_id': 'req-2e106379-2b40-4d7a-9984-04fe49c67df3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.040360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aead5acc7824a119ec6abda05b15aee', 'request_id': 'req-2e106379-2b40-4d7a-9984-04fe49c67df3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.452185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 917/1842] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:27 2022] POST /identity/v3/projects => generated 387 bytes in 996 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:28.456562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:28.535245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e376-0323-4ed6-8108-375919f7e114 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:28.539176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aead5acc7824a119ec6abda05b15aee', 'request_id': 'req-2e106379-2b40-4d7a-9984-04fe49c67df3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.552987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] The token cache is being invalidate because project 3aead5acc7824a119ec6abda05b15aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:28.553383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:28.553868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.554370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.554663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.554933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.555197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.555793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:28.557940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 926/1843] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:27 2022] DELETE /identity/v3/projects/3aead5acc7824a119ec6abda05b15aee => generated 0 bytes in 1349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:28.558179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f7201-3a7b-4034-a06d-c894bcfbbe3f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:28.558749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:28.560380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.641313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e106379-2b40-4d7a-9984-04fe49c67df3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:28.647309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:28.648113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.648581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.649019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] PATH_INFO: `/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.650796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a40e19a11eb4bfcafaaf6e3cbcdd343)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:28.653061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:28.670423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 918/1844] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:28 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:28.672108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.672569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.672916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.711537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:28.713241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.732271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 919/1845] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:28.733337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:28.737114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.761217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3920a4-4ea3-4021-a535-4cc2fed21900 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:28.768854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:28.771003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.771512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.772179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.773802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:28.776161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f29d2-4830-4c53-93f9-faa701b752c4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:28.800798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 920/1846] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:28.802390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.802682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.803092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.811684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a40e19a11eb4bfcafaaf6e3cbcdd343', 'request_id': 'req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.822403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a40e19a11eb4bfcafaaf6e3cbcdd343', 'request_id': 'req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.837102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:28.842421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:28.845572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.936478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 921/1847] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:28.937246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:28.948095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a40e19a11eb4bfcafaaf6e3cbcdd343', 'request_id': 'req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.962657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df9fc-c253-42dc-89a0-9c3139da8c49 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:28.971055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] The token cache is being invalidate because project 5a40e19a11eb4bfcafaaf6e3cbcdd343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:28.971741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.972780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:28.989090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 927/1848] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:28 2022] DELETE /identity/v3/projects/5a40e19a11eb4bfcafaaf6e3cbcdd343 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:28.989090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:28.989090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:28.989859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:28.994631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:28.995265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:28.995872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:28.997501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.001847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408650a-b93e-4c7e-8494-4e01d2d65c07 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.013894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a3050-de1b-4be0-a7a1-1cf9f06a20af admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.026835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 922/1849] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:29.026835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.026835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.026835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.030241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.031237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.031894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.032635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.033928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:29.034475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.036663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.052727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:29.054590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:29.061374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 928/1850] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:29.061374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.064860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:29.068872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 923/1851] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:29.070496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.083630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d258a4-c53e-4d8f-a0fd-98e88559f182 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.088947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.089851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.090627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.090887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.091724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.093840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c23e0-2641-4828-b690-b16c2a8a6a57 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.105946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dad1f-ac1f-40cd-b22a-7eee611723f5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.112821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.113612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.114076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.114497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] PATH_INFO: `/v3/projects/77a4ebe810b74580bd9356b81dcb0c47/users/60f014412b6042b8aae6ac2e7f2739b8/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.134884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a4ebe810b74580bd9356b81dcb0c47, user_id=60f014412b6042b8aae6ac2e7f2739b8, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.137945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.219027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 924/1852] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.220227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39400-014c-49dd-9d70-4576ca02f3c6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.220524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39400-014c-49dd-9d70-4576ca02f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.220800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39400-014c-49dd-9d70-4576ca02f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.242533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-abf39400-014c-49dd-9d70-4576ca02f3c6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:29.243983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-abf39400-014c-49dd-9d70-4576ca02f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:29.254459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 929/1853] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:29 2022] PUT /identity/v3/projects/77a4ebe810b74580bd9356b81dcb0c47/users/60f014412b6042b8aae6ac2e7f2739b8/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:29.254459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.324138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 925/1854] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:29.328924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.329215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.329503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.346082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0925002-3a90-4441-a738-407b12ce7817 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.349475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.350870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.351156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.352047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.353595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.355244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.362259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] MFA Rules not processed for user `60f014412b6042b8aae6ac2e7f2739b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:29.364215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:29.437286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 926/1855] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:29.438189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.448783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb126a4-1331-4245-a184-0c52eed3c22d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.453545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.454309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.454428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.455118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.455437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:29.455747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.457454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.470534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 927/1856] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:29.471373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.482716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689209a3-495b-4c15-a0df-735e9a7c636b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.488422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.489049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.489330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.489599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.490275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.492920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.515967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 930/1857] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.515967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.525746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4f981-0629-4c73-b049-a80eb436ae01 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.530821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.531444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.532070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.532468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.533152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.535507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.602024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 928/1858] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.605998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.633746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 931/1859] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.637789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.682249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9566-406b-4daa-bee5-fe4b8e67cab9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.722893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97475cf9-9b80-4d82-930a-6c8f386c8963 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.728911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.729549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.729828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.730100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.730831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.732948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.749812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.750451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.750731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.751002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.751707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.753406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.767864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 929/1860] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:29.767864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.777160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768d92f-bd19-4806-8361-9ef292eb2d52 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.781904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.787188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.787188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.787188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.787188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.787188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.843953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 932/1861] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.843953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.855433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffe07-df88-4174-bf54-4773742d5b17 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.860775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.868022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.868022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.868491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.869255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.872261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.887288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 930/1862] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:29 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:29.888789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.895834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 933/1863] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:29.900810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.915238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f106d4-e00c-43f1-8cb3-18dc13d31098 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.925251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf0bb-19be-4ed9-9d93-69c1a0f31469 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.930124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.930760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.931040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.931310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.932072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.933921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.942325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.943275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.943582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.943894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:29.945007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:29.947125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:29.949908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 931/1864] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:29.951457 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.965300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 934/1865] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:29.966597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:29.972840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfb84b-e46c-4b3e-83e9-c30e673f77be admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:29.981946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:29.982798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:29.983024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:29.983296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] PATH_INFO: `/v3/projects/46fffbfd950e4f528ea01e4de09ac906/users/156b94a47ddc4df69238f627300647ec/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.003062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fffbfd950e4f528ea01e4de09ac906, user_id=156b94a47ddc4df69238f627300647ec, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.003871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415cea-5f27-4801-a34d-31ddf41ff55c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.006614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.010740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.012328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.012454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.012823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] PATH_INFO: `/v3/projects/5b169a7185394ab38f9fdc8ddece60b8/users/dad89646ce53414aba441df84607a399/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.034605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b169a7185394ab38f9fdc8ddece60b8, user_id=dad89646ce53414aba441df84607a399, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.037719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec855a-4abe-4d99-b01d-071c579000f1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.089512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 932/1866] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:29 2022] PUT /identity/v3/projects/46fffbfd950e4f528ea01e4de09ac906/users/156b94a47ddc4df69238f627300647ec/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:30.091434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.136261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 935/1867] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:29 2022] PUT /identity/v3/projects/5b169a7185394ab38f9fdc8ddece60b8/users/dad89646ce53414aba441df84607a399/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:30.139043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.139043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.139043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.192154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] MFA Rules not processed for user `156b94a47ddc4df69238f627300647ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:30.192154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:30.194233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1477e5-419b-4d71-b499-35ac4161824d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.268554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.269622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.269957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.270355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.271377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.274562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.292124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 933/1868] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:30.293401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.305475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695fb85-870d-4119-b1ef-9fbba5a07772 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.309498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 936/1869] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:30.310556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.311357 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.311751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.312167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.312971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.313864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.314983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.326017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141edcc-8082-4a03-b358-641c345ecb82 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.335282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 934/1870] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:30.335282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.335456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.335456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.335456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.335456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] PATH_INFO: `/v3/projects/6a1c0701dba645c3abc06cf8612a2507/users/69a46b0aaf1b464f8c3c72c55baf44a0/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.345565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f434ec-89b8-4eb1-9a11-9f871e203bd5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.350775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.351607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.351892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.352743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.352864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c0701dba645c3abc06cf8612a2507, user_id=69a46b0aaf1b464f8c3c72c55baf44a0, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.353420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.355649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00178d6-9e7c-40a7-8d1f-4dda2571afff admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.356298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.445944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 937/1871] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:30 2022] PUT /identity/v3/projects/6a1c0701dba645c3abc06cf8612a2507/users/69a46b0aaf1b464f8c3c72c55baf44a0/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:30.446825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.478231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 935/1872] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:30.478231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.478231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.478231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.505213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] MFA Rules not processed for user `69a46b0aaf1b464f8c3c72c55baf44a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:30.507180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:30.513568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640b84f-8ed3-4cba-821f-eda4e322520f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.575183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.576064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.576350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.576662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] PATH_INFO: `/v3/projects/5b169a7185394ab38f9fdc8ddece60b8/users/dad89646ce53414aba441df84607a399/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.577795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 936/1873] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:30.578650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.578912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b169a7185394ab38f9fdc8ddece60b8, user_id=dad89646ce53414aba441df84607a399, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.581871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.591867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890b66f-20d5-4b86-93e9-3bbc4ce4bf8b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.595059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 938/1874] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:30 2022] PUT /identity/v3/projects/5b169a7185394ab38f9fdc8ddece60b8/users/dad89646ce53414aba441df84607a399/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:30.595626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.654173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.654802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.655123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.655394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.656112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.658082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf224-e14d-4983-a2fb-42debf749f4a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.671237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4a9e-0f2b-4ccd-88c4-1ae91a9b1aef admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.675871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.676510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.676788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.677068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.679418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.680627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.754138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 937/1875] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:30.755406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.755688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.755984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.783763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 939/1876] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:30.783763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.786549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] MFA Rules not processed for user `dad89646ce53414aba441df84607a399`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:30.788416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:30.848772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d8ce-ff55-4366-b79c-cb4157549de1 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.855527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.856337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.856685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.857179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.858087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.860489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.862538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 938/1877] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:30.863509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.874776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 940/1878] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:30.878267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.878492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f62f0-2992-452a-8192-cc62a6460bbb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.880303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:30.884550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.885331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.885687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.886036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.886730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.888822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.943377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef57dd-32ae-476c-bd27-77b4698f2430 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.949140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.949804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.950090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.950370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:30.961907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:30.963360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:30.973592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 941/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:30.974422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:30.985842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47466bb6-401e-45bb-9e97-384a58276d3b service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:30.991666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:30.992398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:30.992674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:30.992946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] PATH_INFO: `/v3/projects/726155256c194a09880dd6c046fea04a/users/eb0e3a0b549240c6acd6cdec049d9c46/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.012079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726155256c194a09880dd6c046fea04a, user_id=eb0e3a0b549240c6acd6cdec049d9c46, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.015267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.034511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 939/1880] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:30 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:31.034511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.060000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcabbd-6e01-4aaa-81fb-07358e889a61 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.063877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.065200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.065488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.065997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.066851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.069195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.084167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 940/1881] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:31.089459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.101208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfa9e7-5c49-48eb-a4e3-913c30844b2e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.108660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 942/1882] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:30 2022] PUT /identity/v3/projects/726155256c194a09880dd6c046fea04a/users/eb0e3a0b549240c6acd6cdec049d9c46/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:31.110261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.110898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.111179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.111453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.112393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.114088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.114527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.135270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 941/1883] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:31.139531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.151208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fa508-2e4b-4543-8f67-d94b3ec38168 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.192248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c813c-8774-4c6d-97d1-d6f136f69438 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.199981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.200670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.200966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.201244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.202059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.204408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.221526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.226122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.226122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.226122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] PATH_INFO: `/v3/projects/b6706a4c6577468fa320e3a68d5237be/users/30dc1776bc2c4f379095322e2c3e2372/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.227536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 943/1884] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:31.233635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.247952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308344-e7ec-4890-b17c-8eae6b3bc3eb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.250867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6706a4c6577468fa320e3a68d5237be, user_id=30dc1776bc2c4f379095322e2c3e2372, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.254893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d907-b330-4ed7-99f2-a84d7c27341a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.256311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.257017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.257496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.257704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] PATH_INFO: `/v3/projects/726155256c194a09880dd6c046fea04a/users/eb0e3a0b549240c6acd6cdec049d9c46/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.260299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726155256c194a09880dd6c046fea04a, user_id=eb0e3a0b549240c6acd6cdec049d9c46, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.263285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fd2ba-d102-43af-ab62-b9d9042d3275 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.277632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 944/1885] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:31 2022] PUT /identity/v3/projects/726155256c194a09880dd6c046fea04a/users/eb0e3a0b549240c6acd6cdec049d9c46/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:31.291172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.291172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.291482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.337354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] MFA Rules not processed for user `eb0e3a0b549240c6acd6cdec049d9c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:31.338576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.351391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 942/1886] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:31 2022] PUT /identity/v3/projects/b6706a4c6577468fa320e3a68d5237be/users/30dc1776bc2c4f379095322e2c3e2372/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:31.364556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.365073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.366178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.413455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] MFA Rules not processed for user `30dc1776bc2c4f379095322e2c3e2372`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:31.416831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.438214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 945/1887] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:31.470516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.479408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:31.548134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:31.600085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 943/1888] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:31.605816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:31.606513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.612581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90a6da-3f0b-4e13-abde-c8754533c9bc None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.706049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.706787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.707067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.707347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.709599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f162b3-0769-4b1f-a5f9-be816d9015f8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.717906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.719458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.719746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.720206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.720929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.723826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.800113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.801642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.813669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 946/1889] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:31.844292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 944/1890] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:31 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:31.849678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.869125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832ffd-60e0-46a3-9060-b33b5c963eac service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.935228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:31.935604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:31.935858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:31.936173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:31.936448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:31.937124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:31.939128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895bd0-a2d5-41c9-a19c-958340ca0053 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:31.995729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcfce6-cc18-4c2b-86c3-d08db7f2aa41 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:31.999497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.000158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.000444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.000722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.047738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 947/1891] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:31 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:32.049626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7217f-4c5a-4ff1-9a73-c7f9fb56d01c None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.049915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7217f-4c5a-4ff1-9a73-c7f9fb56d01c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.050195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7217f-4c5a-4ff1-9a73-c7f9fb56d01c None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.051482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 948/1892] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:18:32.052214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7217f-4c5a-4ff1-9a73-c7f9fb56d01c None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.071825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.073381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8a66e-0796-4f67-9044-b49e76aa42e4 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.078858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7217f-4c5a-4ff1-9a73-c7f9fb56d01c None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:32.087107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 945/1893] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:32.088583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.095681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.095681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.096725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.096725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.096725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.096725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.097067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.097067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.110716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 949/1894] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:32.115179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.127026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed115d5-5076-455e-b3cc-796fbdbfff91 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:32.127269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:32.132375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:32.133508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.134197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.134485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.134768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] PATH_INFO: `/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0/users/3da9f85648df45abbad2d8e44a262712/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.169769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6cb7ceb1c4405082c3dffb2b8a79e0, user_id=3da9f85648df45abbad2d8e44a262712, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.174779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.262005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 946/1895] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:18:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:32.276297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 950/1896] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:32 2022] PUT /identity/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0/users/3da9f85648df45abbad2d8e44a262712/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:32.280789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.281250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.283033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:32.307046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217d88b-9b2f-439e-a189-d72d5f827e99 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:32.401671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.403640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.403767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295b361-f277-417c-aff2-871f3d9be992 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:32.403928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.403928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.403928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.405830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.408899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.416028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.416028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.416028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.418991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 947/1897] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:32.420592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.422352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd835088-af97-4286-80ef-6f8eddda2428 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.424065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:32.440074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 951/1898] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:32.451780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f271ed-aec2-4364-a922-e8b9bef0508d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:32.451780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:32.451780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.451780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.452471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] PATH_INFO: `/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0/users/3da9f85648df45abbad2d8e44a262712/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.452471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6cb7ceb1c4405082c3dffb2b8a79e0, user_id=3da9f85648df45abbad2d8e44a262712, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:32.452471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:32.485916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 948/1899] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:32 2022] PUT /identity/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0/users/3da9f85648df45abbad2d8e44a262712/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:32.486101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:32.486101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:32.486101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:32.531308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] MFA Rules not processed for user `3da9f85648df45abbad2d8e44a262712`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:32.532921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:32.677102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 952/1900] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:33.118307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:33.208011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:33.213828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3e4e8-67a6-4c53-ae08-b70c6e790ab0 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:33.218127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:33.218800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:33.219089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:33.219368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:33.222803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1273d2-9278-42fd-9f8d-e7971f20dd8d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:33.227654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:33.228485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:33.228817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:33.229186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:33.230522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:33.231305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:33.232017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:33.243394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 949/1901] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:33.334688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:33.336919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:33.348963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 953/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:33.485364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:33.496495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd08ea-5c9b-4826-acaf-19346fe79661 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:33.501677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:33.502307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:33.502585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:33.502865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:33.567661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:33.569335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:33.579572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 950/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:33.850439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:33.852110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:33.981478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d410d52-4f49-4488-be6c-5c08fee1b71c service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:33.991719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:33.992714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:33.993138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:33.994388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] PATH_INFO: `/v3/users/d2988958f30d406c85b3ed510a7ec5d5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:33.999847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2988958f30d406c85b3ed510a7ec5d5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:33.999847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:34.237450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2988958f30d406c85b3ed510a7ec5d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.249960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2988958f30d406c85b3ed510a7ec5d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.250863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2988958f30d406c85b3ed510a7ec5d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.251818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2988958f30d406c85b3ed510a7ec5d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.258141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:34.259791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.269641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-65ca4e5c-30b8-4ef6-983e-5969e9487a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2988958f30d406c85b3ed510a7ec5d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.276587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916436e-3e3c-4227-94d1-820d7962d3cf service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:34.281137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:34.281781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.282063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.282335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] PATH_INFO: `/v3/users/7274abb3d0694df98bd8a9e04fe36231` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.283530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7274abb3d0694df98bd8a9e04fe36231)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:34.285527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:34.383178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 954/1904] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:33 2022] DELETE /identity/v3/users/d2988958f30d406c85b3ed510a7ec5d5 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:34.387886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.388245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.388482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.409355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:34.410570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.473972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 955/1905] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:34.485623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:34.487169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.496954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7274abb3d0694df98bd8a9e04fe36231'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.506210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7274abb3d0694df98bd8a9e04fe36231'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.507061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7274abb3d0694df98bd8a9e04fe36231'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.525109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7274abb3d0694df98bd8a9e04fe36231'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.580950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420862b-d538-4620-bde2-d6bd56d882e7 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:34.586547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:34.587283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.587648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.587967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.590081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.605930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7274abb3d0694df98bd8a9e04fe36231'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:34.622856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:34.625041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5cee-e606-49c0-b19c-06b191963080 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:34.636542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 956/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:34.644587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 951/1907] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:34 2022] DELETE /identity/v3/users/7274abb3d0694df98bd8a9e04fe36231 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:34.646302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.648212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.648491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.710585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:34.715702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.847536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 957/1908] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:34.862419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:34.863991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:34.924157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6fc22-0fc4-487a-b409-eb4b2cc8372e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:34.928059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:34.928722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:34.929034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:34.929339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:34.943214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:34.945519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:34.957440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 952/1909] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:35.349365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:35.374574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:35.376360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:35.399667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa2a5-a9ec-4a42-a6ae-c5a76a400a1a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:35.408568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:35.409300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:35.409526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:35.409805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] PATH_INFO: `/v3/projects/cd7ee5ff5bd94397a9463a0fe5ee088c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:35.411060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7ee5ff5bd94397a9463a0fe5ee088c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:35.413780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:35.486361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:35.550169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7ee5ff5bd94397a9463a0fe5ee088c', 'request_id': 'req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:35.558484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7ee5ff5bd94397a9463a0fe5ee088c', 'request_id': 'req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:35.652258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7ee5ff5bd94397a9463a0fe5ee088c', 'request_id': 'req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:35.673514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] The token cache is being invalidate because project cd7ee5ff5bd94397a9463a0fe5ee088c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:35.673514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:35.673514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:35.673514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 958/1910] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:35 2022] DELETE /identity/v3/projects/cd7ee5ff5bd94397a9463a0fe5ee088c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:35.673772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:35.674569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:35.696791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:35.704110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:35.714526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e68cc8-2314-4e13-809d-9dfbd06e7004 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:35.809123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:35.809932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:35.810218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:35.810490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] PATH_INFO: `/v3/projects/b80944691aef45f4b662071bffd90174` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:35.811843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80944691aef45f4b662071bffd90174)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:35.814152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:35.820399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b516e-ef8c-4616-a947-2cf2ea0f6ec5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:35.826319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:35.827983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:35.827983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:35.827983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] PATH_INFO: `/v3/users/f0a0afa09c7e418c9a4083c42e554a92` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:35.828972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a0afa09c7e418c9a4083c42e554a92)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:35.831001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:36.030928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80944691aef45f4b662071bffd90174', 'request_id': 'req-36bd27bb-5985-4a75-827c-e0df35d2360d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.031123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a0afa09c7e418c9a4083c42e554a92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.037853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80944691aef45f4b662071bffd90174', 'request_id': 'req-36bd27bb-5985-4a75-827c-e0df35d2360d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.038906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a0afa09c7e418c9a4083c42e554a92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.039679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a0afa09c7e418c9a4083c42e554a92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.040335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a0afa09c7e418c9a4083c42e554a92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.052661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a0afa09c7e418c9a4083c42e554a92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.136398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80944691aef45f4b662071bffd90174', 'request_id': 'req-36bd27bb-5985-4a75-827c-e0df35d2360d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.149341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] The token cache is being invalidate because project b80944691aef45f4b662071bffd90174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:36.149657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.150683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.152328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 953/1911] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:35 2022] DELETE /identity/v3/projects/b80944691aef45f4b662071bffd90174 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:36.157179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:36.160636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.221571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 959/1912] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:35 2022] DELETE /identity/v3/users/f0a0afa09c7e418c9a4083c42e554a92 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:36.221571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:36.221571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.243465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd27bb-5985-4a75-827c-e0df35d2360d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:36.298584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b859a8-3546-4bb1-8dd9-4924b5d594bc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:36.304926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:36.306109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.306109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.306284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] PATH_INFO: `/v3/users/156b94a47ddc4df69238f627300647ec` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.307821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156b94a47ddc4df69238f627300647ec)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:36.309678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:36.312958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:36.313674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.313961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.314292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] PATH_INFO: `/v3/users/5ffe76c1c2894123b0988843b640008b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.315881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffe76c1c2894123b0988843b640008b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:36.318116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:36.539623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffe76c1c2894123b0988843b640008b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.559259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffe76c1c2894123b0988843b640008b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.560052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffe76c1c2894123b0988843b640008b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.577841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffe76c1c2894123b0988843b640008b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.595348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156b94a47ddc4df69238f627300647ec'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.608697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156b94a47ddc4df69238f627300647ec'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.609534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156b94a47ddc4df69238f627300647ec'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.610166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156b94a47ddc4df69238f627300647ec'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.629265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156b94a47ddc4df69238f627300647ec'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.674532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a97cabc2-418e-4466-9c8e-0aa1b1f928a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffe76c1c2894123b0988843b640008b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:36.682924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 954/1913] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:36 2022] DELETE /identity/v3/users/5ffe76c1c2894123b0988843b640008b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:36.808038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:36.808334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:36.808788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:36.811682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 960/1914] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:36 2022] DELETE /identity/v3/users/156b94a47ddc4df69238f627300647ec => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:36.849408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:36.851113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.924468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 955/1915] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:36.936226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:36.937762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:36.982118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:36.985222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:37.004085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe4bd-320c-455e-8e9d-8bec865580aa None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.011441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.013118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.017946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5e6d-5fd3-408b-96c4-761064465fe3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.018303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.027152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.027469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.027757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.028717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.032002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] PATH_INFO: `/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.036780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3098c6494f7d49cf9b5ad9df68ed8c6a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.049775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.060312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.062936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.083843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 961/1916] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:37.188613 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3098c6494f7d49cf9b5ad9df68ed8c6a', 'request_id': 'req-ccc52445-cd5d-4100-af61-7afa539cbd9a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.203633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3098c6494f7d49cf9b5ad9df68ed8c6a', 'request_id': 'req-ccc52445-cd5d-4100-af61-7afa539cbd9a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.285574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3098c6494f7d49cf9b5ad9df68ed8c6a', 'request_id': 'req-ccc52445-cd5d-4100-af61-7afa539cbd9a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.295241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:37.297308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:37.314841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] The token cache is being invalidate because project 3098c6494f7d49cf9b5ad9df68ed8c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:37.314841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.314841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-ccc52445-cd5d-4100-af61-7afa539cbd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.314841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 956/1917] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:36 2022] DELETE /identity/v3/projects/3098c6494f7d49cf9b5ad9df68ed8c6a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:37.315642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119669d-c6a5-4e93-8fdc-47e720e0b29b service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.318288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ead2-d5f7-4409-a51d-d52cc3e1b96f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.319737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ead2-d5f7-4409-a51d-d52cc3e1b96f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.320056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ead2-d5f7-4409-a51d-d52cc3e1b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.368449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a4c6ead2-d5f7-4409-a51d-d52cc3e1b96f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:37.369727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a4c6ead2-d5f7-4409-a51d-d52cc3e1b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:37.410976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.411948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.412966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.413461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] PATH_INFO: `/v3/projects/962a2d3803da4fedac4328979efe71d7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.415412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962a2d3803da4fedac4328979efe71d7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.419285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.474132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 957/1918] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:37.485436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.486748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.487115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.521074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:37.522897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:37.538205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 958/1919] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:37.541681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:37.551478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0b3d5-4c71-46c0-b7c5-eaa397befb65 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.556740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.557037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.557327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.557587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.558288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:37.558609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.560367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.581945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 959/1920] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:18:37.583569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962a2d3803da4fedac4328979efe71d7', 'request_id': 'req-aff8fd09-e841-4aa4-b3ba-6f597caaec26'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.586093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:37.592396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962a2d3803da4fedac4328979efe71d7', 'request_id': 'req-aff8fd09-e841-4aa4-b3ba-6f597caaec26'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.598594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e40f9-16ca-482d-9264-c392f1964ea2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.691660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962a2d3803da4fedac4328979efe71d7', 'request_id': 'req-aff8fd09-e841-4aa4-b3ba-6f597caaec26'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.711604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] The token cache is being invalidate because project 962a2d3803da4fedac4328979efe71d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:37.712179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.713325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:37.718708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 962/1921] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:37 2022] DELETE /identity/v3/projects/962a2d3803da4fedac4328979efe71d7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:37.721314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:37.729087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:37.746896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.748128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.748877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.749392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.750275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.752599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73be01f-400a-4e99-a0a5-c4d544a3ab4c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.839226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fd09-e841-4aa4-b3ba-6f597caaec26 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:37.844404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:37.845068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.845357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.846414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] PATH_INFO: `/v3/projects/46fffbfd950e4f528ea01e4de09ac906` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.847102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fffbfd950e4f528ea01e4de09ac906)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:37.849098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:37.866789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 960/1922] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:37 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:37.871320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:37.871604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:37.871885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:37.909773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:37.911057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.005562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 961/1923] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:38.010721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.013552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.024785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fffbfd950e4f528ea01e4de09ac906', 'request_id': 'req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.028389 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeeed1-8d94-4d2a-99bb-202473cf48b0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.040678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fffbfd950e4f528ea01e4de09ac906', 'request_id': 'req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.075771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:38.108128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.108690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.108982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.109261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.109940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.111890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.130426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fffbfd950e4f528ea01e4de09ac906', 'request_id': 'req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.142191 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] The token cache is being invalidate because project 46fffbfd950e4f528ea01e4de09ac906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:38.142475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.143162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beea5519-0e68-4f36-a1a8-6bfe4d2aa033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.148921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 963/1924] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:37 2022] DELETE /identity/v3/projects/46fffbfd950e4f528ea01e4de09ac906 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:38.148921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.148921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.148921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.180909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:38.182033 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.190068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 964/1925] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:38.190902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.192804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.204677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89217-ac3b-412d-ad34-4bd8549a5272 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.210238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.211150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.212370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.212758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] PATH_INFO: `/v3/users/eb0e3a0b549240c6acd6cdec049d9c46` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.214168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0e3a0b549240c6acd6cdec049d9c46)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.216478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.219730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 962/1926] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:38 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:38.221028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.235948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02a23-01fd-43df-ade2-2ef3d45b9222 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.242945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.243641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.243935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.244221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.244916 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:38.250171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.250171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.260999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 963/1927] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:38.261650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.263287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.277666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3a76c-48c2-42fd-8089-114ceded4f30 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.284792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.285426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.285685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.285955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.286658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.289127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.291325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:38.299508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 964/1928] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:38.300369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.311583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7411-73b2-4e41-8ff5-2a21f0c5288c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.318862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.318862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.318862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.318862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.319233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.320103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.454656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 965/1929] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:38 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:38.455799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.462711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0e3a0b549240c6acd6cdec049d9c46'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.470251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0e3a0b549240c6acd6cdec049d9c46'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.471120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0e3a0b549240c6acd6cdec049d9c46'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.471744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0e3a0b549240c6acd6cdec049d9c46'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.487238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0e3a0b549240c6acd6cdec049d9c46'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:38.530618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518445-6648-419a-9041-93a16bf4b755 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.535983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.536718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.537937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.537937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.539208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.540902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.554630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 966/1930] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:38.555495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.557307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.566934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 965/1931] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:38 2022] DELETE /identity/v3/users/eb0e3a0b549240c6acd6cdec049d9c46 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:38.567574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.570908 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:38.577527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708c77-dfab-4a4b-baba-58ebb46cc854 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.650767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583890-bd05-41bf-8acd-b05c4e13d95b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.659634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.660347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.660630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.660958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] PATH_INFO: `/v3/projects/b481b66d112b41f687ef036a9170a33b/users/f7c468bbde1543daac89612bcc2075c9/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.680697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.681751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.682180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.682632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.684258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.690067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.752106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b481b66d112b41f687ef036a9170a33b, user_id=f7c468bbde1543daac89612bcc2075c9, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.761376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a2a38-801b-4f57-b4b8-bd212f352ce1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.827609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 967/1932] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:38 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:38.828751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.841957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdae457-2b8f-4050-a33b-0875e0732329 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.847864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:38.849430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.849430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.849430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.852181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:38.852716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:38.864627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 968/1933] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:38.869484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:38.882727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf513534-1883-42e2-922c-0d24f86b37d8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:38.887977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 966/1934] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:38 2022] PUT /identity/v3/projects/b481b66d112b41f687ef036a9170a33b/users/f7c468bbde1543daac89612bcc2075c9/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:38.900700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:38.900975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:38.901134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:38.948938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] MFA Rules not processed for user `f7c468bbde1543daac89612bcc2075c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:38.950140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.011742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.012577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.012979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.013398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.014771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.016951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.039541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 969/1935] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:39.040791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.044023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.071633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 967/1936] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:39.072698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.088498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94695-e289-4f4a-bbec-b39e96fcd73b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.093947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.094632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.094915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.096190 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] PATH_INFO: `/v3/projects/4c6ed4a1f3ee4a13b3dcd4930fde8887/users/651f84742b28477c92b2fced7cb78a56/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.125499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6ed4a1f3ee4a13b3dcd4930fde8887, user_id=651f84742b28477c92b2fced7cb78a56, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.129471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.134177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d2a2d-b5b0-4167-992b-2f5c652aa7cc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.138688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.139358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.139706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.140434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.142476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.212154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 968/1937] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:39 2022] PUT /identity/v3/projects/4c6ed4a1f3ee4a13b3dcd4930fde8887/users/651f84742b28477c92b2fced7cb78a56/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:39.213951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.253415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.255346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34cff1-3ac4-4fef-a43d-0e561c1a5b61 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.277356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 970/1938] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:39.293468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.293778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.294046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.330210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972ddf8-776a-4a0e-af1e-8e98009914ba admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.336490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.337232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.337517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.337793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.338480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.340959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.343384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:39.362864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] MFA Rules not processed for user `651f84742b28477c92b2fced7cb78a56`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:39.364619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.418328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 969/1939] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:39.419594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.422080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.439641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 971/1940] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:39.440520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.454577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1e675-7317-4a97-81e0-88433c8b7db6 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.497373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a119-b537-475c-9b3c-c7a13842d9c7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.502326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.503085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.503247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.503518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] PATH_INFO: `/v3/projects/726155256c194a09880dd6c046fea04a` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.504723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726155256c194a09880dd6c046fea04a)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.507413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.517265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.517930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.518209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.518479 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.519145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.521172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.627399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 972/1941] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:39.628337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.638646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7a818-2b7f-4794-8ec9-c99cf3e3e45a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.643620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.644299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.644584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.644861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.645534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.648082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.676936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726155256c194a09880dd6c046fea04a', 'request_id': 'req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:39.684625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726155256c194a09880dd6c046fea04a', 'request_id': 'req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:39.779831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 973/1942] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:39.780963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.817032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726155256c194a09880dd6c046fea04a', 'request_id': 'req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:39.829328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] The token cache is being invalidate because project 726155256c194a09880dd6c046fea04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:39.829620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:39.830340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:39.835870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 970/1943] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:39 2022] DELETE /identity/v3/projects/726155256c194a09880dd6c046fea04a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:39.835870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.837535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.850860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283128-4e5b-4ca4-a854-7622d9f5036d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.858243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.859200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.859642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.860160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.861989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.864105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48fc53-a549-4d57-bcba-10951978eba0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.876212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 974/1944] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:39.877641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.877983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.878599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.901925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:39.903178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.911509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 975/1945] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:39.912385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:39.913697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:39.919581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bb39-6b86-4285-86fa-1c17a2ef3b70 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.924684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.934175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.934175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.934175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.934175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.934935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856164ed-7044-4610-9edf-dd0334da9964 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:39.935113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac659c-8436-4239-8342-e5a1bce7e8cf admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:39.935267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:39.935267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:39.935267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:39.935267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] PATH_INFO: `/v3/projects/a703a0e193f84bd9aac6047b12615081/users/d72c5d276b124ddb94dca777fe4a5583/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:39.951101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a703a0e193f84bd9aac6047b12615081, user_id=d72c5d276b124ddb94dca777fe4a5583, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:39.953812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.045873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 971/1946] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:39 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:40.047173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.047460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.047796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.067527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:40.068845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.078765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 972/1947] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:40.078765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.085459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 976/1948] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:39 2022] PUT /identity/v3/projects/a703a0e193f84bd9aac6047b12615081/users/d72c5d276b124ddb94dca777fe4a5583/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:40.087122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.091969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c6a3-de84-4380-b686-8b7777baa75b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.144698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:40.177804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988f11-6f52-4117-be17-c00e8ba5a592 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.185713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.186612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.186895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.187245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.187872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:40.188206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.189876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.199521 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.200611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.201064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.201497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.202512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.204536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.205086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 977/1949] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:40.206072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.218474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36752178-d3fd-44a8-ba47-6775dd974760 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.219069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 973/1950] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:40.220420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.224194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.225332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.226628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.226918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.227190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.228137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.229765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.241790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc449c8-2fb1-4e17-a710-5350a7e9a207 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.248280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.249200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.249920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.250319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] PATH_INFO: `/v3/users/69a46b0aaf1b464f8c3c72c55baf44a0` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.252056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a46b0aaf1b464f8c3c72c55baf44a0)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.255396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.267176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 978/1951] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:40.268080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.279488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148e1ee-6e0c-46b5-9232-e517c5dce231 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.285941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.286739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.287872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.288499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.289024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.291092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.385670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 979/1952] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:40 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:40.386773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.473644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff040f-a33a-4f47-a9bf-d4c4cfe581e4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.479975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.480680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.480970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.481248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] PATH_INFO: `/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1/users/918bb4516daa465b87f9ed37da48d517/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.507373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee3a540d8cb44a9b0190ef69e6902e1, user_id=918bb4516daa465b87f9ed37da48d517, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.509758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a46b0aaf1b464f8c3c72c55baf44a0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:40.510652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.523012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a46b0aaf1b464f8c3c72c55baf44a0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:40.523679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a46b0aaf1b464f8c3c72c55baf44a0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:40.524327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a46b0aaf1b464f8c3c72c55baf44a0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:40.543149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a46b0aaf1b464f8c3c72c55baf44a0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:40.628820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:40.635938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 980/1953] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:40 2022] PUT /identity/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1/users/918bb4516daa465b87f9ed37da48d517/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:40.636996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.638853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.687116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 974/1954] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:40 2022] DELETE /identity/v3/users/69a46b0aaf1b464f8c3c72c55baf44a0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:40.688100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.690001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.710870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f0412-4871-475f-b810-4305ce5112d6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.761452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566971-7bae-47b9-b392-a15f9288c435 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.766475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.767107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.767389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.767664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.768449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.770383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd6e0-6850-4bad-b237-575d2911790b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.776706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.777387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.777671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.777973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] PATH_INFO: `/v3/projects/a703a0e193f84bd9aac6047b12615081/users/d72c5d276b124ddb94dca777fe4a5583/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.780019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a703a0e193f84bd9aac6047b12615081, user_id=d72c5d276b124ddb94dca777fe4a5583, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.782760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.793953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 981/1955] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:40 2022] PUT /identity/v3/projects/a703a0e193f84bd9aac6047b12615081/users/d72c5d276b124ddb94dca777fe4a5583/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:40.794702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.796382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.862565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1384-c752-4d7d-957b-14b53abff065 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.871070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.871710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.872050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.872348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.873052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.874734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d561b0-a26e-4f99-8390-ba68ed0b222c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.887138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 982/1956] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:40.888529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.888872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.889217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.893001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 975/1957] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:40 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:40.893470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.893470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.896163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.912181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:40.913823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.922078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 983/1958] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:40.923017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:40.932129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] MFA Rules not processed for user `d72c5d276b124ddb94dca777fe4a5583`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:40.934074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:40.934201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a991a9-2480-4a26-b64b-5e1abf091432 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:40.938639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:40.939347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:40.939656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:40.939869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] PATH_INFO: `/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1/users/918bb4516daa465b87f9ed37da48d517/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:40.949332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee3a540d8cb44a9b0190ef69e6902e1, user_id=918bb4516daa465b87f9ed37da48d517, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:40.952306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:40.970168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 984/1959] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:40 2022] PUT /identity/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1/users/918bb4516daa465b87f9ed37da48d517/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:40.971027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.009009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 976/1960] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:41.012834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.014371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.069244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b236c-f54c-45dd-a237-cf9f6cfab3d9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.077420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c507a-8cf8-4ea1-a9b3-28c822373725 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.087259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.088246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.088530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.088806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.089516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.091177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38c26c-f9a1-4a56-a8c4-2593721464a8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.103791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 985/1961] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:41.107765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.107765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.107765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.139713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.140485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.140872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.141253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.165062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] MFA Rules not processed for user `918bb4516daa465b87f9ed37da48d517`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:41.166011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.166380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.167463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.184122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 977/1962] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:41.185378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.186790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.284241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 986/1963] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:41.285568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.286324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a56fd9-fe90-4d47-9f16-37a26065305c service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.291898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.292611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.292919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.293194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.299316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493342-86f5-4ab6-bbee-daed58a0f638 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.306058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.307033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.307366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.307648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.308557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.310401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.323945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 987/1964] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:41.327872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.346659 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4f61-4c75-4f61-a970-c1ef8302491a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.358266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.362186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.362610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.363310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] PATH_INFO: `/v3/projects/16a37e9dcc2e41a3b7fcb8f891c3c9c1/users/dd0164db1f1344d8858e7c02747c7c26/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.387158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a37e9dcc2e41a3b7fcb8f891c3c9c1, user_id=dd0164db1f1344d8858e7c02747c7c26, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.392792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.395848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.397684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.409608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 978/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:41.416982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.418707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.433262 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e88dd-457f-4502-ae43-874f79c19051 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.438297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.438727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.439013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.439406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.451659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.453250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec1e00-f335-438a-bf59-58a128419b93 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.464569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 979/1966] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:41.525893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 988/1967] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:41 2022] PUT /identity/v3/projects/16a37e9dcc2e41a3b7fcb8f891c3c9c1/users/dd0164db1f1344d8858e7c02747c7c26/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:41.540391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.540391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.544553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.602359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] MFA Rules not processed for user `dd0164db1f1344d8858e7c02747c7c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:41.604660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.645622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.731518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 980/1968] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:41.732731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.752876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e11e-3ac9-4aca-b0ef-043996530477 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.760939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.761748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.762026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.762312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] PATH_INFO: `/v3/users/651f84742b28477c92b2fced7cb78a56` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.763526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651f84742b28477c92b2fced7cb78a56)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.769356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.814431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69109c7d-7c90-47ac-b20c-4e9db9a7a720 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.814431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.814431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.814431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.815095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.817134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:41.906629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.908119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.919818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 981/1969] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:41.921991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.933959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71ce3-b7de-471b-9aaf-2f33f8770f2d service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:41.942789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:41.942789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:41.942789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:41.942789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:41.951084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:41.952742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:41.964753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 982/1970] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:41.965531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:41.966979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.001929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70873d34-a0e8-407d-9456-e57809869760 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:42.005141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651f84742b28477c92b2fced7cb78a56'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.015678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651f84742b28477c92b2fced7cb78a56'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.016608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651f84742b28477c92b2fced7cb78a56'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.017943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:42.018737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.019027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.019307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] PATH_INFO: `/v3/projects/6a1c0701dba645c3abc06cf8612a2507` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.024071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1c0701dba645c3abc06cf8612a2507)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:42.026328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:42.033853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651f84742b28477c92b2fced7cb78a56'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.057451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:42.119340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651f84742b28477c92b2fced7cb78a56'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.127368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 989/1971] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:41 2022] DELETE /identity/v3/users/651f84742b28477c92b2fced7cb78a56 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:42.128269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:42.133139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.156618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:42.198361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1c0701dba645c3abc06cf8612a2507', 'request_id': 'req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.205993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1c0701dba645c3abc06cf8612a2507', 'request_id': 'req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.242053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcc407-eff8-4682-ad09-da5650a957a3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:42.313957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:42.314685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.315037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.315407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] PATH_INFO: `/v3/users/dd0164db1f1344d8858e7c02747c7c26` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.316885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0164db1f1344d8858e7c02747c7c26)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:42.319275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:42.330820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1c0701dba645c3abc06cf8612a2507', 'request_id': 'req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.343897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] The token cache is being invalidate because project 6a1c0701dba645c3abc06cf8612a2507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:42.344485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.345261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-61cb3ab6-b30a-4bf8-b617-d6273902fe1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.347632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 983/1972] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:41 2022] DELETE /identity/v3/projects/6a1c0701dba645c3abc06cf8612a2507 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:42.353200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.353538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.353823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.374990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:42.376175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.384086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 984/1973] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:42.384902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:42.388992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.398641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00ec9-666c-4789-ba16-4ad937399a6a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:42.412116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:42.412116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.412116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.412116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] PATH_INFO: `/v3/users/30dc1776bc2c4f379095322e2c3e2372` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.413274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc1776bc2c4f379095322e2c3e2372)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:42.413274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:42.532199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0164db1f1344d8858e7c02747c7c26'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.544942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0164db1f1344d8858e7c02747c7c26'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.545689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0164db1f1344d8858e7c02747c7c26'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.566597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0164db1f1344d8858e7c02747c7c26'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.633123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc1776bc2c4f379095322e2c3e2372'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.643243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc1776bc2c4f379095322e2c3e2372'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.648920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc1776bc2c4f379095322e2c3e2372'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.648920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc1776bc2c4f379095322e2c3e2372'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.661164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2ec0fbee-5ef3-4c1f-ad43-89faa602cac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc1776bc2c4f379095322e2c3e2372'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.697817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0164db1f1344d8858e7c02747c7c26'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:42.711335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 990/1974] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:42 2022] DELETE /identity/v3/users/dd0164db1f1344d8858e7c02747c7c26 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:42.711335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:42.713395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.785670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894259-6e07-4822-89bd-22adf4da48a1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:42.790305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:42.791238 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.791608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.792069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.796652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.802501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 985/1975] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:42 2022] DELETE /identity/v3/users/30dc1776bc2c4f379095322e2c3e2372 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:42.804845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:42.805333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:42.805715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:42.828647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:42.830285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.887988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:42.889319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:42.906919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 991/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:42.959957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 986/1977] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:42.970762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:42.972292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:42.984077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f33cc2-9090-4370-b80d-0512c656dd80 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:43.045267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:43.046199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.046559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.046985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.064085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:43.077395 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:43.092770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 992/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:43.280097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:43.379645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:43.381302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:43.405797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed4dc-ae87-44e7-8782-58e512881b4b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:43.427813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:43.429339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.429790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.430073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] PATH_INFO: `/v3/projects/b6706a4c6577468fa320e3a68d5237be` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.433435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6706a4c6577468fa320e3a68d5237be)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:43.437120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:43.641020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6706a4c6577468fa320e3a68d5237be', 'request_id': 'req-8b9853ac-8036-412e-98ee-f999b70a126f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:43.658790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6706a4c6577468fa320e3a68d5237be', 'request_id': 'req-8b9853ac-8036-412e-98ee-f999b70a126f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:43.772488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6706a4c6577468fa320e3a68d5237be', 'request_id': 'req-8b9853ac-8036-412e-98ee-f999b70a126f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:43.799848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] The token cache is being invalidate because project b6706a4c6577468fa320e3a68d5237be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:43.800318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:43.802358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:43.805780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 987/1979] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:43 2022] DELETE /identity/v3/projects/b6706a4c6577468fa320e3a68d5237be => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:43.810065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:43.824314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656c47-fed1-41cc-a012-225a5e0023bf service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:43.901102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:43.901837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.902336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.902678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] PATH_INFO: `/v3/users/3da9f85648df45abbad2d8e44a262712` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.904350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da9f85648df45abbad2d8e44a262712)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:43.907355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:43.931876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:43.935419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:43.967826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9853ac-8036-412e-98ee-f999b70a126f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:43.973846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:43.974699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:43.976100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:43.976823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] PATH_INFO: `/v3/projects/4c6ed4a1f3ee4a13b3dcd4930fde8887` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:43.978430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6ed4a1f3ee4a13b3dcd4930fde8887)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:43.980712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:44.058511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:44.170237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6ed4a1f3ee4a13b3dcd4930fde8887', 'request_id': 'req-03689cf6-f782-411c-a2fc-1c1f86012da0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.180405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6ed4a1f3ee4a13b3dcd4930fde8887', 'request_id': 'req-03689cf6-f782-411c-a2fc-1c1f86012da0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.181498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da9f85648df45abbad2d8e44a262712'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.207591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da9f85648df45abbad2d8e44a262712'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.208759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da9f85648df45abbad2d8e44a262712'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.232737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da9f85648df45abbad2d8e44a262712'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.307830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6ed4a1f3ee4a13b3dcd4930fde8887', 'request_id': 'req-03689cf6-f782-411c-a2fc-1c1f86012da0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.320969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] The token cache is being invalidate because project 4c6ed4a1f3ee4a13b3dcd4930fde8887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:44.321261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.322099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.323744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 988/1980] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:43 2022] DELETE /identity/v3/projects/4c6ed4a1f3ee4a13b3dcd4930fde8887 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:44.324768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:44.326144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:44.383412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da9f85648df45abbad2d8e44a262712'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.393745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 993/1981] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:43 2022] DELETE /identity/v3/users/3da9f85648df45abbad2d8e44a262712 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:44.395470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:44.397934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:44.422294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03689cf6-f782-411c-a2fc-1c1f86012da0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:44.488536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e526b3a-75ad-451c-b139-1d54718645b2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:44.495586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:44.496369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:44.496656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:44.496939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] PATH_INFO: `/v3/users/b1eb121aea284330b3476b832fb1879a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:44.498161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1eb121aea284330b3476b832fb1879a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:44.500588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:44.522637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:44.523731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:44.524044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:44.524324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] PATH_INFO: `/v3/projects/16a37e9dcc2e41a3b7fcb8f891c3c9c1` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:44.526003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a37e9dcc2e41a3b7fcb8f891c3c9c1)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:44.527954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:44.570958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:44.708413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a37e9dcc2e41a3b7fcb8f891c3c9c1', 'request_id': 'req-48296804-cc10-4419-ba30-462210c4f9d6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.721271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a37e9dcc2e41a3b7fcb8f891c3c9c1', 'request_id': 'req-48296804-cc10-4419-ba30-462210c4f9d6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.723001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1eb121aea284330b3476b832fb1879a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.749115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1eb121aea284330b3476b832fb1879a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.749950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1eb121aea284330b3476b832fb1879a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.781749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1eb121aea284330b3476b832fb1879a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.832870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a37e9dcc2e41a3b7fcb8f891c3c9c1', 'request_id': 'req-48296804-cc10-4419-ba30-462210c4f9d6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.845063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] The token cache is being invalidate because project 16a37e9dcc2e41a3b7fcb8f891c3c9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:44.845345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.846023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:44.847578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 989/1982] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:44 2022] DELETE /identity/v3/projects/16a37e9dcc2e41a3b7fcb8f891c3c9c1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:44.848411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:44.850808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:44.930703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296804-cc10-4419-ba30-462210c4f9d6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:44.935666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:44.936489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:44.936781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:44.937059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] PATH_INFO: `/v3/users/918bb4516daa465b87f9ed37da48d517` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:44.938267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918bb4516daa465b87f9ed37da48d517)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:44.940241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.023486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-855008b3-81ce-4af0-9b75-e5d1c8665b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1eb121aea284330b3476b832fb1879a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.036113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 994/1983] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:44 2022] DELETE /identity/v3/users/b1eb121aea284330b3476b832fb1879a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:45.039009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.039169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.039719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.078870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.085075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.226354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918bb4516daa465b87f9ed37da48d517'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.227282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 995/1984] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.235668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.237837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.247402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918bb4516daa465b87f9ed37da48d517'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.249812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918bb4516daa465b87f9ed37da48d517'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.250810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918bb4516daa465b87f9ed37da48d517'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.253616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1164-4e66-4296-af9f-d227c9287733 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.265628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.266628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.268328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.269444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] PATH_INFO: `/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.272664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6cb7ceb1c4405082c3dffb2b8a79e0)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.277295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.281343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bdfb6e11-9f0c-4b4b-b418-d96a8e83ed01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918bb4516daa465b87f9ed37da48d517'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.308184 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:45.372138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 990/1985] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:44 2022] DELETE /identity/v3/users/918bb4516daa465b87f9ed37da48d517 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:45.373522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257a28-5bc0-4391-862f-55a9a3e8f1bc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.374019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257a28-5bc0-4391-862f-55a9a3e8f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.374711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43257a28-5bc0-4391-862f-55a9a3e8f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.400946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-43257a28-5bc0-4391-862f-55a9a3e8f1bc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.403415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-43257a28-5bc0-4391-862f-55a9a3e8f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.451754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6cb7ceb1c4405082c3dffb2b8a79e0', 'request_id': 'req-88d1cf1c-8a78-42d9-b702-2a803116a77b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.465753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6cb7ceb1c4405082c3dffb2b8a79e0', 'request_id': 'req-88d1cf1c-8a78-42d9-b702-2a803116a77b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.488869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 991/1986] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.492225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ea42e-96eb-4a6f-a7a7-9ce1ce4d2845 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.492225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ea42e-96eb-4a6f-a7a7-9ce1ce4d2845 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.492225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ea42e-96eb-4a6f-a7a7-9ce1ce4d2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.524920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3a8ea42e-96eb-4a6f-a7a7-9ce1ce4d2845 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.526488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3a8ea42e-96eb-4a6f-a7a7-9ce1ce4d2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.565391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6cb7ceb1c4405082c3dffb2b8a79e0', 'request_id': 'req-88d1cf1c-8a78-42d9-b702-2a803116a77b'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.582685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] The token cache is being invalidate because project 8d6cb7ceb1c4405082c3dffb2b8a79e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:45.583233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.584193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:45.586706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 996/1987] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:45 2022] DELETE /identity/v3/projects/8d6cb7ceb1c4405082c3dffb2b8a79e0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:45.588429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.590364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.610324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 992/1988] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.611722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.612053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.612334 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.648160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.650363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.664087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 993/1989] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.672219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.677376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce4a87-96e4-4969-ab2e-f23c5afeeaf6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.684649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.684649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.684649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.684649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.685739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:45.686149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.688653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09ae3-a03c-41ba-897e-41fc11f49981 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.692696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cf1c-8a78-42d9-b702-2a803116a77b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.698444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.705741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.705741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.705741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.705741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.706089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 994/1990] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:45.706089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.706592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.706975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.724477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.726974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.739775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:45.742206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:45.752432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 997/1991] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:45.757361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 995/1992] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:45.758740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.766312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.772120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa6b3-82bb-4e52-958c-16d2c78a2a1f service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.778773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.779826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9156ba8-e3c2-4f9a-a9a5-34ae4869d495 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.780280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.781305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.782393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.783423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.787187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.788605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.791860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.791860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.791860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.791860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:45.791860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.793763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.815117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 996/1993] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:45.820639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:45.836672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dac6e-30c6-400c-9bd8-1ecd158404c6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:45.852056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:45.852804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:45.853161 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:45.853558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:45.854329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:45.856565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:45.971056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 998/1994] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:45.976182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.007432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 997/1995] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:46.012181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.053785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:46.129881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3daea-ec44-4d63-b2e0-d8346a1ca83c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.156657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb98c9-8612-4d31-8c3a-238b9bab4b33 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.173028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.173674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.173963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.174247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.175375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.177392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.219145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.219827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.222432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.222755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.223853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.227047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.354308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 998/1996] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:46 2022] POST /identity/v3/users => generated 284 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:46.358144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.389513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224096-498c-43d9-bb97-1106f7f2b9c9 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.395133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.395771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.396141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.396423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.397844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.399738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.418407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 999/1997] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:46.419347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.430025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4cec9-cdd0-4bf2-867c-f775def50bc8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.433504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 999/1998] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:45 2022] POST /identity/v3/users => generated 289 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:46.438196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.450518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.451595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.452406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.452887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.453949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.456068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.479944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1000/1999] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:46.479944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.484565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:46.494007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44425a91-8949-4376-bd80-6b8004af3698 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.505626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.507690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.508572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.510108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.510807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.513500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48956f0a-f59f-437e-8f9f-ed6b45c92131 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.515362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.540701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.540701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.540701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.540701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] PATH_INFO: `/v3/projects/2ef7c9400b06496e9e539cbdac889bfb` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.541034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef7c9400b06496e9e539cbdac889bfb)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.549496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.556040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1000/2000] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:46.556040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.566176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:46.610410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da285a-295e-4136-a87d-d4fb563aab97 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.617020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:46.618072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:46.618579 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:46.619054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] PATH_INFO: `/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:46.620899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee3a540d8cb44a9b0190ef69e6902e1)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:46.623115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:46.743661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef7c9400b06496e9e539cbdac889bfb', 'request_id': 'req-cd55528f-673a-48b5-a80f-6a66e75d215a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.750367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef7c9400b06496e9e539cbdac889bfb', 'request_id': 'req-cd55528f-673a-48b5-a80f-6a66e75d215a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.854637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee3a540d8cb44a9b0190ef69e6902e1', 'request_id': 'req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.863164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:46.866345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef7c9400b06496e9e539cbdac889bfb', 'request_id': 'req-cd55528f-673a-48b5-a80f-6a66e75d215a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.868593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee3a540d8cb44a9b0190ef69e6902e1', 'request_id': 'req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.884075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] The token cache is being invalidate because project 2ef7c9400b06496e9e539cbdac889bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:46.884362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.885109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.886676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1001/2001] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:46 2022] DELETE /identity/v3/projects/2ef7c9400b06496e9e539cbdac889bfb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:46.890002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:46.890002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:46.960326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55528f-673a-48b5-a80f-6a66e75d215a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:46.981690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee3a540d8cb44a9b0190ef69e6902e1', 'request_id': 'req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.998039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] The token cache is being invalidate because project 5ee3a540d8cb44a9b0190ef69e6902e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:46.998519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:46.999232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.004818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1001/2002] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:46 2022] DELETE /identity/v3/projects/5ee3a540d8cb44a9b0190ef69e6902e1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:47.005764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.007668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.024621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.025495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.025803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.026137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] PATH_INFO: `/v3/projects/d6baa4fb7fbe46e1862baedebe6fe778/users/8a4a442560a947dba2c7db040afa28c5/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.044435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6baa4fb7fbe46e1862baedebe6fe778, user_id=8a4a442560a947dba2c7db040afa28c5, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.047171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.080595 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd92-ddb0-46d6-9c40-7b8b61450682 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.085695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.086456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.086746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.087028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.087732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.089440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.104126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1002/2003] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:47.104126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.104126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.118733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f9b5-a177-4f5e-ae3c-96524d4ca177 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.123845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.124589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.124881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.125166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] PATH_INFO: `/v3/users/f7c468bbde1543daac89612bcc2075c9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.126437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c468bbde1543daac89612bcc2075c9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.128427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.137004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1002/2004] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:46 2022] PUT /identity/v3/projects/d6baa4fb7fbe46e1862baedebe6fe778/users/8a4a442560a947dba2c7db040afa28c5/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:47.138049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.145954 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.214327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8fef7-6fd7-4c3b-af1e-1741d8a12517 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.219144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.219781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.220095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.220386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] PATH_INFO: `/v3/users/60f014412b6042b8aae6ac2e7f2739b8` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.221557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f014412b6042b8aae6ac2e7f2739b8)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.223553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.309995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c468bbde1543daac89612bcc2075c9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.316849 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c468bbde1543daac89612bcc2075c9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.317555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c468bbde1543daac89612bcc2075c9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.329399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c468bbde1543daac89612bcc2075c9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.399069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c7ba14be-a34f-4d9f-91a9-7b9c1f253f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c468bbde1543daac89612bcc2075c9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.406291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1003/2005] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:47 2022] DELETE /identity/v3/users/f7c468bbde1543daac89612bcc2075c9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:47.407564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.407848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.408154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.413867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:47.414693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f014412b6042b8aae6ac2e7f2739b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.422067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f014412b6042b8aae6ac2e7f2739b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.422842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f014412b6042b8aae6ac2e7f2739b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.423471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f014412b6042b8aae6ac2e7f2739b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.430788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:47.432092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.435600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73af2d3f-e4a4-4673-9cf6-1682818e7b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f014412b6042b8aae6ac2e7f2739b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:47.492211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1004/2006] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:47.492975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.494337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.506798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cfa10-4a75-4d60-b3f7-57d076fb9112 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.508431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1003/2007] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:47 2022] DELETE /identity/v3/users/60f014412b6042b8aae6ac2e7f2739b8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:47.514500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f21e9-5209-4827-84eb-14fa9599ea94 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.514500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f21e9-5209-4827-84eb-14fa9599ea94 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.514500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f21e9-5209-4827-84eb-14fa9599ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.544082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4e4f21e9-5209-4827-84eb-14fa9599ea94 None None] MFA Rules not processed for user `8a4a442560a947dba2c7db040afa28c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:47.545427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4e4f21e9-5209-4827-84eb-14fa9599ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.574109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.574785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.575073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.575360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] PATH_INFO: `/v3/projects/65f08a2f159c40be8236277ba2529885/users/8eda886ddaf84c43b298929b438fda6e/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.592705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f08a2f159c40be8236277ba2529885, user_id=8eda886ddaf84c43b298929b438fda6e, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.596094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.615016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1004/2008] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:47.616950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906723-1d99-4ce1-b8a6-a0949c6d667a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.617243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906723-1d99-4ce1-b8a6-a0949c6d667a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.617524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af906723-1d99-4ce1-b8a6-a0949c6d667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.636220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-af906723-1d99-4ce1-b8a6-a0949c6d667a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:47.637463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-af906723-1d99-4ce1-b8a6-a0949c6d667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.645452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1005/2009] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:47.646595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.647041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.647316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.667813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:47.669065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.677490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1006/2010] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:47.679053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.680446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.692536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccbc6f-e554-495a-a507-088dd5f4e799 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.697991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.698634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.698989 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.699247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.699929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.701965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.730727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1005/2011] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:47 2022] PUT /identity/v3/projects/65f08a2f159c40be8236277ba2529885/users/8eda886ddaf84c43b298929b438fda6e/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:47.733350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.733350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.806058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1007/2012] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:47.807368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.829833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac178cd-5829-4d1a-9eeb-558bdcd059e6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.882352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2729b-cf63-4cb1-a80e-690d8c775a86 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.887760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.888434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.888715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.889006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.889878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:47.890203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.891861 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735751-9c39-4238-ac39-57b18320987b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.898230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.898873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.899152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.899430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.910600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1008/2013] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:47.910600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342c39-e848-41c5-a926-468198b144da None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.910600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342c39-e848-41c5-a926-468198b144da None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.910600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d342c39-e848-41c5-a926-468198b144da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.910996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.913489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.929606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1006/2014] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:47.930765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:47.945483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd139-e300-4f9d-845f-c9cb5cc41d2d service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:47.948860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7d342c39-e848-41c5-a926-468198b144da None None] MFA Rules not processed for user `8eda886ddaf84c43b298929b438fda6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:47.950969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7d342c39-e848-41c5-a926-468198b144da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:47.951820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:47.953629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:47.953629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:47.953629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:47.953912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:47.958786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:47.962699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.029473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1009/2015] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:48.030252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342c39-e848-41c5-a926-468198b144da None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.042613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d342c39-e848-41c5-a926-468198b144da None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.047628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.048206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1007/2016] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:47 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:48.048347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.048556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.048807 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.049583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.051433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.052307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.054612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.161701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428aa-a379-40b4-a5db-d03b25ab0d7d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.165554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.166181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.166481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.166735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.175727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.177216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.187976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1010/2017] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:48 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:48.188235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1008/2018] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:48.189060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.190436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.192906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.202925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e9543-33b5-4dd1-b40d-53143e014d4c service glance] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.220887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.299749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.300433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.304330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.304838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.306208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.309536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.324797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1009/2019] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:48.329710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.358691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4f1a-d444-475f-8c4c-7de72f51c876 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.361864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd861-eeea-4a2a-b670-51a5e5380cb4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.371266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.372300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.372754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.373163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.373467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.374806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.375165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.375896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.376695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] PATH_INFO: `/v3/projects/77a4ebe810b74580bd9356b81dcb0c47` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.379305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a4ebe810b74580bd9356b81dcb0c47)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.379507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.384289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.476726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1010/2020] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:48 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:48.478041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.492646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714573b-686c-4cea-b1dc-dc23ef006dbf admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.519143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.520503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.521628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.524246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] PATH_INFO: `/v3/projects/a12c25819ac74fef8749a84f659c9ba9/users/579a1ac2babd4a7fa8f4b572274a83b5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.532436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a4ebe810b74580bd9356b81dcb0c47', 'request_id': 'req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:48.548483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a4ebe810b74580bd9356b81dcb0c47', 'request_id': 'req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:48.559444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:48.562419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12c25819ac74fef8749a84f659c9ba9, user_id=579a1ac2babd4a7fa8f4b572274a83b5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.565632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.667400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a4ebe810b74580bd9356b81dcb0c47', 'request_id': 'req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:48.678919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] The token cache is being invalidate because project 77a4ebe810b74580bd9356b81dcb0c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:48.679216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:48.679897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:48.681480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1011/2021] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:48 2022] DELETE /identity/v3/projects/77a4ebe810b74580bd9356b81dcb0c47 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:48.682277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.683604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.712895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1011/2022] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:48 2022] PUT /identity/v3/projects/a12c25819ac74fef8749a84f659c9ba9/users/579a1ac2babd4a7fa8f4b572274a83b5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:48.714401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.720987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.775687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd06-b7d7-4f98-a1e6-fe9cccc23dd6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.800037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470cd1-e4b7-4ebf-8c53-e0af1622f7a9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.808072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.808837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.809263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.810346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] PATH_INFO: `/v3/users/dad89646ce53414aba441df84607a399` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.811049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad89646ce53414aba441df84607a399)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.813180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.852467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.853109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.853397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.853665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.854381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.856054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.867822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1012/2023] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:48.868757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:48.870495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:48.884578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72f3d-7960-4a31-9485-e34506508159 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:48.890708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:48.891369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:48.891651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:48.892968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] PATH_INFO: `/v3/projects/b481b66d112b41f687ef036a9170a33b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:48.893180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b481b66d112b41f687ef036a9170a33b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:48.895127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:48.948241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:49.029819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:49.039498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad89646ce53414aba441df84607a399'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.050571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad89646ce53414aba441df84607a399'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.050747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b481b66d112b41f687ef036a9170a33b', 'request_id': 'req-9c7707f7-940d-4f61-ac6c-ea884132f723'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.051243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad89646ce53414aba441df84607a399'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.058876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b481b66d112b41f687ef036a9170a33b', 'request_id': 'req-9c7707f7-940d-4f61-ac6c-ea884132f723'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.067050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad89646ce53414aba441df84607a399'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.141874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b481b66d112b41f687ef036a9170a33b', 'request_id': 'req-9c7707f7-940d-4f61-ac6c-ea884132f723'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.156758 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] The token cache is being invalidate because project b481b66d112b41f687ef036a9170a33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:49.156928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.157846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.159736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1013/2024] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:48 2022] DELETE /identity/v3/projects/b481b66d112b41f687ef036a9170a33b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:49.167157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.169134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.187804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad89646ce53414aba441df84607a399'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.198644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1012/2025] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:48 2022] DELETE /identity/v3/users/dad89646ce53414aba441df84607a399 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:49.198644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.198644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.275792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba9124-4cb3-43cb-a945-6c0a9ac58e09 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.281569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.282212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.282497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.282609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7707f7-940d-4f61-ac6c-ea884132f723 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.282904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.283750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.285458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.288809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.289583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.290018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.290391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.291358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.293140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.304423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1013/2026] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:49.304423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.304867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.309633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1014/2027] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:49.309633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.309633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.319779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c5ff-51a8-43eb-833b-b9e8f62bd956 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.327309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.328082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.328182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4085-ec77-4ff2-b7a6-afa822efbcf6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.328495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.328841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] PATH_INFO: `/v3/users/d72c5d276b124ddb94dca777fe4a5583` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.330108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72c5d276b124ddb94dca777fe4a5583)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.332353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.333801 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.334820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.335383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.335765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] PATH_INFO: `/v3/projects/9dfc8c9f08c94b0e83340b7001db5d1a/users/b574cba74a5048d19dfd12bf4870c400/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.355538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfc8c9f08c94b0e83340b7001db5d1a, user_id=b574cba74a5048d19dfd12bf4870c400, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.358298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.477007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:49.508587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1015/2028] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:49 2022] PUT /identity/v3/projects/9dfc8c9f08c94b0e83340b7001db5d1a/users/b574cba74a5048d19dfd12bf4870c400/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:49.510201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.532465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:49.584900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f166-30fb-45fc-8e44-a190c7b44d04 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.589458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.590123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.590406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.590680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] PATH_INFO: `/v3/projects/a12c25819ac74fef8749a84f659c9ba9/users/579a1ac2babd4a7fa8f4b572274a83b5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.592779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12c25819ac74fef8749a84f659c9ba9, user_id=579a1ac2babd4a7fa8f4b572274a83b5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.595434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703aa2-4e1b-45c5-8909-be08e71d0086 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.603184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72c5d276b124ddb94dca777fe4a5583'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.613921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1016/2029] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:49 2022] PUT /identity/v3/projects/a12c25819ac74fef8749a84f659c9ba9/users/579a1ac2babd4a7fa8f4b572274a83b5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:49.613921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180d5-a1c9-4d83-9a0b-af5db606fd7c None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.613921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180d5-a1c9-4d83-9a0b-af5db606fd7c None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.613921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180d5-a1c9-4d83-9a0b-af5db606fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.619216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72c5d276b124ddb94dca777fe4a5583'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.620038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72c5d276b124ddb94dca777fe4a5583'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.634252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72c5d276b124ddb94dca777fe4a5583'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.646588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-87b180d5-a1c9-4d83-9a0b-af5db606fd7c None None] MFA Rules not processed for user `b574cba74a5048d19dfd12bf4870c400`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:49.648756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-87b180d5-a1c9-4d83-9a0b-af5db606fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.723297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1017/2030] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:49.726001 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.726509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.726792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.737027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72c5d276b124ddb94dca777fe4a5583'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:49.747535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1014/2031] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:49 2022] DELETE /identity/v3/users/d72c5d276b124ddb94dca777fe4a5583 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:49.748710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.750572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.760534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] MFA Rules not processed for user `579a1ac2babd4a7fa8f4b572274a83b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:49.765483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.863065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1018/2032] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:49.864988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:49.873585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:49.935765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a1d8d-1149-44db-a929-32a5bbc37333 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.940905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.941583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.941894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.942196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.942948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.945808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:49.960070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9a8ef-0050-4283-883c-bc348d4b7e3f None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:49.979686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:49.979686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:49.979686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:49.979686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] PATH_INFO: `/v3/projects/5b169a7185394ab38f9fdc8ddece60b8` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:49.980107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b169a7185394ab38f9fdc8ddece60b8)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:49.980107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.039016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1015/2033] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:49 2022] POST /identity/v3/projects => generated 409 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:50.039955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.041919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.058136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.104997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ff6db-91ec-4feb-ad95-5f348623a119 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.108981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.109600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.110054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.110331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.122873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b169a7185394ab38f9fdc8ddece60b8', 'request_id': 'req-6914e70b-42ad-4f7e-9936-5a30b59220c8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:50.130449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b169a7185394ab38f9fdc8ddece60b8', 'request_id': 'req-6914e70b-42ad-4f7e-9936-5a30b59220c8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:50.148052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.189086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b169a7185394ab38f9fdc8ddece60b8', 'request_id': 'req-6914e70b-42ad-4f7e-9936-5a30b59220c8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:50.203824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] The token cache is being invalidate because project 5b169a7185394ab38f9fdc8ddece60b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:50.204764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:50.205299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:50.205945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.207089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1019/2034] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:49 2022] DELETE /identity/v3/projects/5b169a7185394ab38f9fdc8ddece60b8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:50.212461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.212609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7565b7-5f62-46e7-a005-32e9dcc2be0d service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.212694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.221034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1016/2035] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:50.223108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984f0c-e201-481a-900e-26fc1a282c14 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.223684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984f0c-e201-481a-900e-26fc1a282c14 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.224329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984f0c-e201-481a-900e-26fc1a282c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.251242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-09984f0c-e201-481a-900e-26fc1a282c14 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:50.252861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-09984f0c-e201-481a-900e-26fc1a282c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.328047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914e70b-42ad-4f7e-9936-5a30b59220c8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.333342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.333977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.334813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.335326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.336320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.338298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.360898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.373556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1017/2036] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:50.383847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.383847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.384334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.425260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:50.426786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.448739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1018/2037] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:50.453504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.454019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1020/2038] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:50 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:50.461003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.464783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35bcd-3ef9-4809-9c3b-2b3f313583ef None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.470769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.471408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.471523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04528-5a29-405e-b48f-7c6b5fb7a448 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.471695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.473786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.473786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:50.473786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.476144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.482997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.484119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.484511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.484693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.489798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.494665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.504330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1019/2039] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:18:50.507469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.520473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1021/2040] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:50.520473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.522957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.533820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd43b-4588-43de-b7b5-ac1089919fbc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.540922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.541575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.541853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.542126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.542805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.544863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.597358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6340e56-717f-4af7-be16-1b9282f3fef4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.601811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.602455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.602737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.603015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.605007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:50.659774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1020/2041] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:50 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:50.660771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.689360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.691300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.704373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1022/2042] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:50.704986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.718441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5d95-0c36-4aa3-8b02-f89eeea81f74 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.762866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d686c-a4eb-438a-b575-cc6e9c70cd09 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:50.770569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.771277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.771561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.772110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] PATH_INFO: `/v3/projects/8375cd55761b4a768fe5089c93b532be/users/b191da5e96b04cafacd3b4d6f827a229/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.783339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.799516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8375cd55761b4a768fe5089c93b532be, user_id=b191da5e96b04cafacd3b4d6f827a229, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.799516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.817108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.911985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:50.913414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:50.914041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:50.914358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:50.915139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:50.917296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:50.979493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1021/2043] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:50 2022] PUT /identity/v3/projects/8375cd55761b4a768fe5089c93b532be/users/b191da5e96b04cafacd3b4d6f827a229/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:50.980406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:50.982063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.060009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035136b9-1997-44e7-bb7d-cc9356f01464 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.064826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.065590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.065873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.066293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] PATH_INFO: `/v3/projects/a703a0e193f84bd9aac6047b12615081` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.067531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a703a0e193f84bd9aac6047b12615081)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.069854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.073884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1023/2044] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:50 2022] POST /identity/v3/users => generated 291 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:51.075077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.087221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573aa15-dab9-4e67-a5f5-e31168f44083 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.095395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.099039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.099039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.099039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.099039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.102073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.123181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1024/2045] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:51.124407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.136247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813beb7-4878-444e-91fb-28f65acdcd3d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.141616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.142259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.142527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.142802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.143513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.145443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.160067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1025/2046] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:51.160939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.173416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71504be5-9582-43d5-8620-cc0aa98b17b3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.176569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:51.179447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.180154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.180441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.184339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] PATH_INFO: `/v3/projects/8375cd55761b4a768fe5089c93b532be/users/b191da5e96b04cafacd3b4d6f827a229/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.184339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8375cd55761b4a768fe5089c93b532be, user_id=b191da5e96b04cafacd3b4d6f827a229, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.185581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.197050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1026/2047] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:51 2022] PUT /identity/v3/projects/8375cd55761b4a768fe5089c93b532be/users/b191da5e96b04cafacd3b4d6f827a229/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:51.197892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.232493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a703a0e193f84bd9aac6047b12615081', 'request_id': 'req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:51.241071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a703a0e193f84bd9aac6047b12615081', 'request_id': 'req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:51.282741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad199-32c1-4aa1-9ba8-ddb6eab1386f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.309882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a703a0e193f84bd9aac6047b12615081', 'request_id': 'req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:51.358469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] The token cache is being invalidate because project a703a0e193f84bd9aac6047b12615081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:51.361008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:51.361887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9c143b8-d842-4a57-9e1b-4e3b9e6b597d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:51.367540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1022/2048] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:50 2022] DELETE /identity/v3/projects/a703a0e193f84bd9aac6047b12615081 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:51.371525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188190a5-8e73-4a37-bc82-baa63026e317 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.371525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188190a5-8e73-4a37-bc82-baa63026e317 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.371525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188190a5-8e73-4a37-bc82-baa63026e317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.380216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.380987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.381341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.381750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.382885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.386735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13c24-bb96-49cd-bb5f-be3c978fc973 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.399679 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1027/2049] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:51.403216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.403216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.403216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.434507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:51.434507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.449494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1028/2050] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:51.457254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.459123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.464150 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-188190a5-8e73-4a37-bc82-baa63026e317 None None] MFA Rules not processed for user `b191da5e96b04cafacd3b4d6f827a229`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:51.466042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-188190a5-8e73-4a37-bc82-baa63026e317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.487470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:51.489167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db5a6-f312-48c6-8627-c4345443e9a6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.508816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.514393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.514860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.515242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] PATH_INFO: `/v3/projects/af41306d659b402ca2045cd343c1ea90/users/290a9b80696d416ea82397f4c069af24/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.567477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af41306d659b402ca2045cd343c1ea90, user_id=290a9b80696d416ea82397f4c069af24, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.571381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.622827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1023/2051] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:51.627945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.628249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.629759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.667505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:51.668506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.678582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1024/2052] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:51.679301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.680973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.710970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1029/2053] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:51 2022] PUT /identity/v3/projects/af41306d659b402ca2045cd343c1ea90/users/290a9b80696d416ea82397f4c069af24/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:51.724186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.736937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:51.764483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668e3b-b04b-4137-b669-8027d51ed9ad None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.800181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02dd3-c8f6-4807-9865-9ed26126f87f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.806731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.807240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.807502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.807818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.815686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:51.815686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.815686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198ad5-b78d-4ebc-bd9c-64a5d2c3d68b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.824315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1030/2054] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:51.825719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.826178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.826404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.830242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.830876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.831160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.831763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.859268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] MFA Rules not processed for user `290a9b80696d416ea82397f4c069af24`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:51.860715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:51.909259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.910946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.921988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1025/2055] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:51.922984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.935257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88721-a984-40d6-b38c-2bf75e80cdbe service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.940816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.941066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.941358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.941679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.942313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.943317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1031/2056] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:51.945146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:51.948647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:51.959545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a11007-cf24-42c5-9e16-456a2cbb217e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:51.964976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:51.965613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:51.965895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:51.966231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:51.966912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:51.968933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.054261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1026/2057] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:52.058861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.130562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1032/2058] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:51 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:52.131509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.138231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd5a9-85c9-4414-aa24-7702734a43c2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.223420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.224298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.224411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.224606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.226177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.228355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.237963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae814-1286-4b54-8147-3eac7c7a6a43 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.244929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.245555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.245851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.246120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.246790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.248768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.342187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1027/2059] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:52 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:52.343947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1033/2060] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:52 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:52.348998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.349479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.360189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:52.366428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2787-4de8-4aad-9bef-cc3a72fb389b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.373190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.373949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.374252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.374575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.375307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.375531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba66b-c81a-424d-af19-5bf6cc55440f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.377303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.384730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.385979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.386546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.387099 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.388476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.389522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1028/2061] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:52.391605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.393906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.414045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1034/2062] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:52.415598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb90ef-461d-444a-9492-259e27e59206 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.419602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.426085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:52.426272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.426272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.426272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.426272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.426587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.426587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.440020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1029/2063] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:52.440526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.452608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530a33c-e15d-493e-8a7a-2483e8c8b52f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.458100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.458867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.459883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.460282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] PATH_INFO: `/v3/projects/9cfa6acf715c48ad92e074f84520ed39/users/579908840b9d4ed69c7173e0965b1f2e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.489101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa6acf715c48ad92e074f84520ed39, user_id=579908840b9d4ed69c7173e0965b1f2e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.492641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.521068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee198e77-ce18-4d6c-8227-e582ecaf5b91 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.521068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.521068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.521068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.521385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.523549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:52.586020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1030/2064] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:52 2022] PUT /identity/v3/projects/9cfa6acf715c48ad92e074f84520ed39/users/579908840b9d4ed69c7173e0965b1f2e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:52.589113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.604655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.606116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.619323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1035/2065] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:18:52.620460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.638597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a347-6ed2-4bce-a8f3-394d193a6151 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.680384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:52.684638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6988e-fdc4-4705-a45b-94ebe8ef5297 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.690184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.690876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.691160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.691757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] PATH_INFO: `/v3/projects/769ed1dc5a9449d9ab54d891b8072523/users/e72ec472515a474e894cb71433a9b037/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.708620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ed1dc5a9449d9ab54d891b8072523, user_id=e72ec472515a474e894cb71433a9b037, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.712512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd95ab-48d6-4071-b4ac-efa8283ca37c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.723045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.724463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.724581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.725682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.726615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.728351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.745519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1036/2066] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:52.749833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.762048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c217-3e30-40fb-a426-3cce4c11f3ed admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:52.772329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:52.773068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.773321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.773597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] PATH_INFO: `/v3/projects/9cfa6acf715c48ad92e074f84520ed39/users/579908840b9d4ed69c7173e0965b1f2e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.777056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa6acf715c48ad92e074f84520ed39, user_id=579908840b9d4ed69c7173e0965b1f2e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:52.781138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d14fae-c8b7-4fdd-bc2b-96f6ba04a9f7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:52.784753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1031/2067] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:52 2022] PUT /identity/v3/projects/769ed1dc5a9449d9ab54d891b8072523/users/e72ec472515a474e894cb71433a9b037/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:52.796929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1037/2068] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:52 2022] PUT /identity/v3/projects/9cfa6acf715c48ad92e074f84520ed39/users/579908840b9d4ed69c7173e0965b1f2e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:52.811312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.816516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.816516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.821430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:52.821721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:52.822007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:52.854180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] MFA Rules not processed for user `e72ec472515a474e894cb71433a9b037`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:52.855607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:52.870368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] MFA Rules not processed for user `579908840b9d4ed69c7173e0965b1f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:52.871592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:52.981183 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1032/2069] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:52.985881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:52.989313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1038/2070] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:53.000424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.061783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07400d55-ecab-4105-8753-b2338b828f66 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.064491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e75a2-9c3b-4c23-a18e-c7ffceac3ff0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.067214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.067880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.068188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.069035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.069652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.069808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.070393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.070674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.070947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.071728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.082966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.085776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.104393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1039/2071] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:53.138535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1033/2072] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:52 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:53.143103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.161249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f527a4c-49bd-4d6d-8c42-91869a7db753 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.205861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:53.246729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.246729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.246729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.249779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.249779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.249779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.369675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1040/2073] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:53 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:53.376579 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.388094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611846-fafd-4938-8392-195fc9757188 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.393275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.397079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.397079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.397079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.397079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.398002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.409791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1034/2074] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:53.414987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.442285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f583f7-cde8-4b0b-8442-21fb9f79d4e2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.452955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.453822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.454106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.454436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] PATH_INFO: `/v3/projects/2df4920cca2e42869be63d5a551d7a39/users/d31c7ae2dccd4837b4b569c499b84c83/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.477265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4920cca2e42869be63d5a551d7a39, user_id=d31c7ae2dccd4837b4b569c499b84c83, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.480495 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.568605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1041/2075] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:53 2022] PUT /identity/v3/projects/2df4920cca2e42869be63d5a551d7a39/users/d31c7ae2dccd4837b4b569c499b84c83/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:53.571786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.588059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b444d1-3ba4-4edd-a044-de1b147388fc admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.646466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.647218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.647503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.647778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.648515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.650534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4306-1863-4295-b198-c7ad414d06e7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.663638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1035/2076] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:53.666077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.676471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb34d80-dce7-4a06-9c2d-158b70f5a002 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.681998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.682654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.682938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.683357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] PATH_INFO: `/v3/projects/2df4920cca2e42869be63d5a551d7a39/users/d31c7ae2dccd4837b4b569c499b84c83/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.688944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4920cca2e42869be63d5a551d7a39, user_id=d31c7ae2dccd4837b4b569c499b84c83, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.688944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.717601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1042/2077] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:53 2022] PUT /identity/v3/projects/2df4920cca2e42869be63d5a551d7a39/users/d31c7ae2dccd4837b4b569c499b84c83/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:53.730120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.730691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.730883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.731161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.766326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] MFA Rules not processed for user `d31c7ae2dccd4837b4b569c499b84c83`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:53.768289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:53.812389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8969-740d-49c9-9d0b-04137404e811 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.819768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.820598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.820925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.838672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] PATH_INFO: `/v3/users/290a9b80696d416ea82397f4c069af24` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.838672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=290a9b80696d416ea82397f4c069af24)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.838672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.859571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1036/2078] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:53.873905 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:53.929227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf639-2beb-43b0-b68e-68542d7141ff None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:53.932988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:53.933613 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:53.933894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:53.934179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:53.944028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:53.945585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:53.955501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1037/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:54.127751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:54.127751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5f4f5-a73b-43e5-a43f-8fc552d7bf24 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:54.127751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:54.127751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.129594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.129594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] PATH_INFO: `/v3/users/e72ec472515a474e894cb71433a9b037` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.129594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72ec472515a474e894cb71433a9b037)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:54.129594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:54.525248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:54.542406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290a9b80696d416ea82397f4c069af24'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.550318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290a9b80696d416ea82397f4c069af24'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.551129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290a9b80696d416ea82397f4c069af24'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.551932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290a9b80696d416ea82397f4c069af24'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.557812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72ec472515a474e894cb71433a9b037'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.567005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72ec472515a474e894cb71433a9b037'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.567673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0496d54-2b27-4a81-a62e-60285b4e53fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290a9b80696d416ea82397f4c069af24'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.567873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72ec472515a474e894cb71433a9b037'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.582416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72ec472515a474e894cb71433a9b037'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.713815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1043/2080] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:53 2022] DELETE /identity/v3/users/290a9b80696d416ea82397f4c069af24 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:54.719944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.724737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.728499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.750339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:54.751570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:54.812150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1044/2081] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:54.822538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:54.823982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:54.827499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-25886b9d-e4a3-4c75-98fd-7f24085a457f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72ec472515a474e894cb71433a9b037'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:54.845961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1038/2082] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:53 2022] DELETE /identity/v3/users/e72ec472515a474e894cb71433a9b037 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:54.847543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:54.847899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:54.848353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:54.872920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:54.874506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:54.926657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a77e1-4f8a-4048-9484-e23855ef2d67 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:54.968786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1039/2083] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:54.979413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:55.000467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:55.001100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:55.001450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:55.001692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:55.012398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:55.014226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:55.025612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1045/2084] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:55.028892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:55.046590 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8fa5f-f207-456d-996a-beb323b22ead None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:55.050691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:55.051486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:55.051861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:55.052122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:55.062675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:55.064224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:55.083722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1040/2085] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:55.613167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:55.614346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:55.615689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:55.616442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:55.641736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaeee9-f4f9-494e-b36e-85b7b7a13e4b service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:55.651465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4377-ce62-4d14-9c7a-b259ea8c56ad service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:55.659283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:55.660119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:55.660393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:55.660783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] PATH_INFO: `/v3/projects/af41306d659b402ca2045cd343c1ea90` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:55.662230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af41306d659b402ca2045cd343c1ea90)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:55.665373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:55.674038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:55.674680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:55.674971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:55.675251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] PATH_INFO: `/v3/projects/769ed1dc5a9449d9ab54d891b8072523` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:55.677445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ed1dc5a9449d9ab54d891b8072523)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:55.679869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:55.776217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:55.852919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ed1dc5a9449d9ab54d891b8072523', 'request_id': 'req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.853192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af41306d659b402ca2045cd343c1ea90', 'request_id': 'req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.859866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af41306d659b402ca2045cd343c1ea90', 'request_id': 'req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.860622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ed1dc5a9449d9ab54d891b8072523', 'request_id': 'req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.970382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af41306d659b402ca2045cd343c1ea90', 'request_id': 'req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.986842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] The token cache is being invalidate because project af41306d659b402ca2045cd343c1ea90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:55.987182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.987789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:55.989567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1041/2086] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:55 2022] DELETE /identity/v3/projects/af41306d659b402ca2045cd343c1ea90 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:55.994936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:55.995956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:56.021786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ed1dc5a9449d9ab54d891b8072523', 'request_id': 'req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.050591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] The token cache is being invalidate because project 769ed1dc5a9449d9ab54d891b8072523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:56.050891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.051817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.057453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1046/2087] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:55 2022] DELETE /identity/v3/projects/769ed1dc5a9449d9ab54d891b8072523 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:56.063450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:56.065883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:56.080732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9706fc0-fab4-4f6f-a6d1-c77515d9319e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:56.086990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:56.088144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:56.089560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:56.089560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] PATH_INFO: `/v3/users/579908840b9d4ed69c7173e0965b1f2e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:56.090575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579908840b9d4ed69c7173e0965b1f2e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:56.092896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:56.151694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf6e0-1af0-4f27-ae97-f89b544fc30b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:56.160826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:56.160826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:56.160826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:56.160826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] PATH_INFO: `/v3/users/d31c7ae2dccd4837b4b569c499b84c83` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:56.162133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31c7ae2dccd4837b4b569c499b84c83)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:56.162133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:56.352422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:56.360177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579908840b9d4ed69c7173e0965b1f2e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.369880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579908840b9d4ed69c7173e0965b1f2e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.370830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579908840b9d4ed69c7173e0965b1f2e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.381633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31c7ae2dccd4837b4b569c499b84c83'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.390991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31c7ae2dccd4837b4b569c499b84c83'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.391949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31c7ae2dccd4837b4b569c499b84c83'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.393198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31c7ae2dccd4837b4b569c499b84c83'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.400614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579908840b9d4ed69c7173e0965b1f2e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.409578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31c7ae2dccd4837b4b569c499b84c83'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.514812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579908840b9d4ed69c7173e0965b1f2e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:56.525765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1042/2088] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:55 2022] DELETE /identity/v3/users/579908840b9d4ed69c7173e0965b1f2e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:56.623083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1047/2089] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:18:56 2022] DELETE /identity/v3/users/d31c7ae2dccd4837b4b569c499b84c83 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:57.107729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:57.171882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:57.173798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.276689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980752f-8fa7-4ed4-9b67-450eda6a5461 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:57.347232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:57.348011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.348290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.348565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] PATH_INFO: `/v3/projects/2df4920cca2e42869be63d5a551d7a39` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.349753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df4920cca2e42869be63d5a551d7a39)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:57.352503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:57.466126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:57.470855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.509160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119c0c-b35b-4ff3-80d5-181d73db3e05 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:57.515397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df4920cca2e42869be63d5a551d7a39', 'request_id': 'req-aa411f2a-0977-4973-932a-e9aee47c4c77'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.537027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df4920cca2e42869be63d5a551d7a39', 'request_id': 'req-aa411f2a-0977-4973-932a-e9aee47c4c77'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.591894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:57.592924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.592924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.594693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] PATH_INFO: `/v3/projects/9cfa6acf715c48ad92e074f84520ed39` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.594693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfa6acf715c48ad92e074f84520ed39)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:57.596594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:57.618322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df4920cca2e42869be63d5a551d7a39', 'request_id': 'req-aa411f2a-0977-4973-932a-e9aee47c4c77'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.637604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] The token cache is being invalidate because project 2df4920cca2e42869be63d5a551d7a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:57.637893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.639376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa411f2a-0977-4973-932a-e9aee47c4c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.640604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:57.650364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1043/2090] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:57 2022] DELETE /identity/v3/projects/2df4920cca2e42869be63d5a551d7a39 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:57.661246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbda35-11c2-4736-880e-c0feb0e9bbe1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.661246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbda35-11c2-4736-880e-c0feb0e9bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.661246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbda35-11c2-4736-880e-c0feb0e9bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.690450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2cfbda35-11c2-4736-880e-c0feb0e9bbe1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:57.691781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2cfbda35-11c2-4736-880e-c0feb0e9bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.714064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1044/2091] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:57.721022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfa6acf715c48ad92e074f84520ed39', 'request_id': 'req-da816853-e2bf-404b-aca4-ddf462b8f9f9'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.722465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.722817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.723214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.731464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfa6acf715c48ad92e074f84520ed39', 'request_id': 'req-da816853-e2bf-404b-aca4-ddf462b8f9f9'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.747661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:57.749511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.826639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1045/2092] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:57.830921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:57.847046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bccddc-4ecd-48f4-9eae-c5a3cee2bcab None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:57.847258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:57.847881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.848197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.848476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.849206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:57.849514 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:57.851785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:57.855015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfa6acf715c48ad92e074f84520ed39', 'request_id': 'req-da816853-e2bf-404b-aca4-ddf462b8f9f9'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.868038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] The token cache is being invalidate because project 9cfa6acf715c48ad92e074f84520ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:18:57.868331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.868797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1046/2093] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:18:57.872874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-da816853-e2bf-404b-aca4-ddf462b8f9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:18:57.873302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:57.875131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1048/2094] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:18:57 2022] DELETE /identity/v3/projects/9cfa6acf715c48ad92e074f84520ed39 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:57.875260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.880917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebae4c-02db-4f21-8a27-e76db521f001 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.882113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebae4c-02db-4f21-8a27-e76db521f001 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.882572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebae4c-02db-4f21-8a27-e76db521f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.889868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c194b-e5c1-4a24-bfaf-f5957922adff admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:57.895399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:57.896077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.896367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.896645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.897528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:57.899510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:57.911036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-61ebae4c-02db-4f21-8a27-e76db521f001 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:57.911036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-61ebae4c-02db-4f21-8a27-e76db521f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:57.938551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1049/2095] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:57.949372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:57.949852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:57.950271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:57.985122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:57.986335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:58.000957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1050/2096] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:58.002246 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.013566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b314-cc5f-4d2a-9644-cc227b97581e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.035708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.041953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.043223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.044235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.045721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:18:58.046411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.048264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.070553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1051/2097] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:18:58.075311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.076375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1047/2098] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:57 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:58.080112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.103462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2f748-45df-4a04-bea3-4e7de72eb2b0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.210225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b2104-2cb1-419b-b091-241e4120d33b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.218491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.219668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.220613 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.221192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.222930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.227736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.260236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.261028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.261313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.261718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.262276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.264359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.325484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1048/2099] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:18:58.330057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.341823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd533d24-4316-43d3-8304-ef8262dcc326 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.346871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.347567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.347938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.348293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.349012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.351374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.361773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1049/2100] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:58.367355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.377188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1052/2101] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:58.378997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.382552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6134-bb34-4bec-9aca-678f9ce86869 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.462942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929364-c9e5-4465-bac4-98328d25a9dd admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.467050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.467868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.468777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.469317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.469433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.470317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.470613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.470903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.471363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.471646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.473616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.474001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.494688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1050/2102] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:58.499208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.509691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0db82-2cc8-444d-8860-ffeb7a88ecac admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.514614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.515164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.515452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.515728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] PATH_INFO: `/v3/projects/e6ddb1ed230445de82f597721ecd29ae/users/809fb377331f4ad097b7e02b163bf27c/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.532318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ddb1ed230445de82f597721ecd29ae, user_id=809fb377331f4ad097b7e02b163bf27c, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.539444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79739f37-738f-4379-9ceb-bf2a16de370e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.610909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1053/2103] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:58.615176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.627857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8cbab-d891-4df6-b9ef-fb34ada247ed admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.633514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.634416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.634718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.635206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.636107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.637952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.650602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1054/2104] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:18:58.651430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1051/2105] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:58 2022] PUT /identity/v3/projects/e6ddb1ed230445de82f597721ecd29ae/users/809fb377331f4ad097b7e02b163bf27c/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:18:58.654999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.663175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.666506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.666993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.690946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40319fc7-985a-4683-a544-dc5366351072 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.748619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] MFA Rules not processed for user `809fb377331f4ad097b7e02b163bf27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:58.752225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:58.775797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.776627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.779106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.779106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.779106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.779748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.791663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1055/2106] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:58.798292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.815971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dc2c-6a99-4df4-8e30-2dd0e18e6daa admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.827997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.828700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.828986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.829271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] PATH_INFO: `/v3/projects/73512b39b333480589f4204844a94376/users/a29d940aa5204573a88c371abc95706f/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.850030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73512b39b333480589f4204844a94376, user_id=a29d940aa5204573a88c371abc95706f, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.853220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bac327-16f7-4ff1-a2e4-a0b4a335b16c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.865768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1052/2107] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:58.870563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:58.884264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec2930-9ed8-4e1f-a218-ec899fedd280 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:58.891311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:58.892001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.892616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.892954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:58.893601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:58.896333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:58.982058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1056/2108] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:58 2022] PUT /identity/v3/projects/73512b39b333480589f4204844a94376/users/a29d940aa5204573a88c371abc95706f/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:58.994030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:58.995080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:58.995859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.038090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1053/2109] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:59.041776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.056448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] MFA Rules not processed for user `a29d940aa5204573a88c371abc95706f`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:59.058096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:59.118974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:59.144986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb760c-cb6d-459c-8399-71365829582e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.153575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.154472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.154817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.156527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.157889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.159924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.190442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1057/2110] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:18:59.207049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.208878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:59.280631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b94e2f-6339-4700-a1e7-341c998dadaa None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.284532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.285160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.285737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.286020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.297100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.298289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:59.298775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.309524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1054/2111] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:18:59 2022] POST /identity/v3/users => generated 303 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:18:59.311825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.316886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1058/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:18:59.323348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217293-94da-4da3-8d99-60e05e025d5f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.328546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.329263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.329725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.330185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.331229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.333072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.352862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1055/2113] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:59.358546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.379047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa956e9-ee91-4ac7-b79c-197fc8b1f1da service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.384466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.385366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.386210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.386210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] PATH_INFO: `/v3/projects/b64104ca36cc4efa8831e87275d8df0c/users/ed694927435641369f080c4f09d6519c/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.413579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64104ca36cc4efa8831e87275d8df0c, user_id=ed694927435641369f080c4f09d6519c, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.417165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.531119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1059/2114] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:59 2022] PUT /identity/v3/projects/b64104ca36cc4efa8831e87275d8df0c/users/ed694927435641369f080c4f09d6519c/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:59.535583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.548090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e88040-60d1-4685-9383-1982cd6fafe4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.624918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.628868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.628868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.628868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.628868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.628868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbec7-4e18-423a-b2d5-55a465a9bc92 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.643453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1056/2115] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:18:59.643657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:59.649481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.662997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d98bc-eb5f-4051-ae54-a4b4ecfa7057 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.669449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.669449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.669449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.669823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] PATH_INFO: `/v3/projects/b64104ca36cc4efa8831e87275d8df0c/users/ed694927435641369f080c4f09d6519c/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.671997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64104ca36cc4efa8831e87275d8df0c, user_id=ed694927435641369f080c4f09d6519c, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.677091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.721239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1060/2116] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:18:59 2022] PUT /identity/v3/projects/b64104ca36cc4efa8831e87275d8df0c/users/ed694927435641369f080c4f09d6519c/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:18:59.723637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.724719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.725696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.768961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] MFA Rules not processed for user `ed694927435641369f080c4f09d6519c`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:18:59.770241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:59.860596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1057/2117] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:18:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:18:59.883805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:18:59.886077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:18:59.963306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffade3e7-2b56-4469-9e71-177c1f98a522 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:18:59.968012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:18:59.973687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:18:59.973687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:18:59.973687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:18:59.983969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:18:59.985602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:18:59.996806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1061/2118] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:18:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:00.161339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:00.176757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493ac93-dcb2-41c6-a543-28dcb8301d46 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:00.181568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:00.182206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.182486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.183259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.290133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:00.292856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c44e5-f8e5-4f1b-925e-40c0085f553b service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:00.307469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1058/2119] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:00.320563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:00.322515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:00.463670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927996a-3365-4411-923e-d9028f1e9be5 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:00.479309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:00.480685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.481321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.481960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] PATH_INFO: `/v3/users/8a4a442560a947dba2c7db040afa28c5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.484973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4a442560a947dba2c7db040afa28c5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:00.489797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:00.680328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4a442560a947dba2c7db040afa28c5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:00.724756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4a442560a947dba2c7db040afa28c5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:00.726045 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4a442560a947dba2c7db040afa28c5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:00.727769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4a442560a947dba2c7db040afa28c5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:00.759172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4a442560a947dba2c7db040afa28c5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:00.845082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1062/2120] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:00 2022] DELETE /identity/v3/users/8a4a442560a947dba2c7db040afa28c5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:00.850348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bb2-d356-4bab-aad4-6a3112ebda2e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:00.850536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bb2-d356-4bab-aad4-6a3112ebda2e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:00.850769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bb2-d356-4bab-aad4-6a3112ebda2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:00.886004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-08f39bb2-d356-4bab-aad4-6a3112ebda2e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:00.886004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-08f39bb2-d356-4bab-aad4-6a3112ebda2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:00.964201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1059/2121] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:00.976713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:00.979765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:01.021086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:01.065543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98242-ab42-48bf-b1ce-955ace56d0b1 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:01.070615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:01.071265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:01.071775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:01.072097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:01.083378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:01.086194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:01.098446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1063/2122] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:01.204618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:01.337943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25659-64ba-441b-afff-fb9e1c44fa8c None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:01.338516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25659-64ba-441b-afff-fb9e1c44fa8c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:01.338894 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25659-64ba-441b-afff-fb9e1c44fa8c None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:01.340412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1060/2123] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:19:01.487175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:01.489018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:01.506232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ec87b-b31d-4efd-a604-b0245b612e50 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:01.512247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:01.513283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:01.513769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:01.514211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] PATH_INFO: `/v3/users/b574cba74a5048d19dfd12bf4870c400` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:01.515639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b574cba74a5048d19dfd12bf4870c400)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:01.517884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:01.578406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:01.578692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:01.578968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:01.610342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:01.610342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:01.688766 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1061/2124] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:19:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:01.690152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:01.692227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:01.726946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdb1cd-4919-43a2-88b0-dd0feeec32fe None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:01.732503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:01.733393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:01.733503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:01.733756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] PATH_INFO: `/v3/projects/d6baa4fb7fbe46e1862baedebe6fe778` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:01.735111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6baa4fb7fbe46e1862baedebe6fe778)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:01.737234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:01.822639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b574cba74a5048d19dfd12bf4870c400'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.829826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b574cba74a5048d19dfd12bf4870c400'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.830542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b574cba74a5048d19dfd12bf4870c400'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.831210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b574cba74a5048d19dfd12bf4870c400'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.844711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b574cba74a5048d19dfd12bf4870c400'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.898792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6baa4fb7fbe46e1862baedebe6fe778', 'request_id': 'req-a2bbf07d-52bc-4496-979f-a112a8dfea1d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:01.905643 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6baa4fb7fbe46e1862baedebe6fe778', 'request_id': 'req-a2bbf07d-52bc-4496-979f-a112a8dfea1d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.004258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1064/2125] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:01 2022] DELETE /identity/v3/users/b574cba74a5048d19dfd12bf4870c400 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:02.005268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:02.007886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.081749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4cc95-2f8e-41c0-a716-4b9729706181 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:02.088665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:02.089341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.089625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.089984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.091846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.108284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:02.108284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:02.118627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1065/2126] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:02.119810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:02.122016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.165146 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6baa4fb7fbe46e1862baedebe6fe778', 'request_id': 'req-a2bbf07d-52bc-4496-979f-a112a8dfea1d'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.180889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] The token cache is being invalidate because project d6baa4fb7fbe46e1862baedebe6fe778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:02.181223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.181873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2bbf07d-52bc-4496-979f-a112a8dfea1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.183407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1062/2127] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:01 2022] DELETE /identity/v3/projects/d6baa4fb7fbe46e1862baedebe6fe778 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:02.184634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.184915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.185185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.199879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8691b-1ca5-46e5-8c9e-c91c01c79281 service placement] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:02.206918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:02.207322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:02.207686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.208008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.208288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] PATH_INFO: `/v3/users/fe7723d1854c42b9b1b3684c8d2daff0` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.208789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.210351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7723d1854c42b9b1b3684c8d2daff0)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:02.212343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:02.218190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1063/2128] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:02.220383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:02.228969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.244086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b6b07-fb71-4ebe-82d4-98d2cb41f6be None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:02.249373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:02.250241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.250539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.250826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] PATH_INFO: `/v3/users/579a1ac2babd4a7fa8f4b572274a83b5` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.252112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579a1ac2babd4a7fa8f4b572274a83b5)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:02.254132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:02.470441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579a1ac2babd4a7fa8f4b572274a83b5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.472090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7723d1854c42b9b1b3684c8d2daff0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.478413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579a1ac2babd4a7fa8f4b572274a83b5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.479133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579a1ac2babd4a7fa8f4b572274a83b5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.479598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7723d1854c42b9b1b3684c8d2daff0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.480283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7723d1854c42b9b1b3684c8d2daff0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.481154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7723d1854c42b9b1b3684c8d2daff0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.491300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579a1ac2babd4a7fa8f4b572274a83b5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.492668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7723d1854c42b9b1b3684c8d2daff0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.614902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579a1ac2babd4a7fa8f4b572274a83b5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:02.624560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1064/2129] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:02 2022] DELETE /identity/v3/users/579a1ac2babd4a7fa8f4b572274a83b5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:02.628512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:02.630268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.681799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1066/2130] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:02 2022] DELETE /identity/v3/users/fe7723d1854c42b9b1b3684c8d2daff0 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:02.701706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629866-67a6-41b1-9876-a5614cc5a852 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:02.808854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:02.809616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.809931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.810204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.813388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.876954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:02.915571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:02.917201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c70835-593e-47cf-8e8e-c214dd5da311 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:02.927692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1065/2131] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:02.969727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:02.971178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:02.986930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea96-ac74-48fc-9a84-ef7b8c6c8d89 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:02.994204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:02.994928 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:02.995275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:02.995769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] PATH_INFO: `/v3/projects/a821bf10ffb1420ea3ecff42f7355d42` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:02.997029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a821bf10ffb1420ea3ecff42f7355d42)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.008894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.062321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:03.158323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a821bf10ffb1420ea3ecff42f7355d42', 'request_id': 'req-d4a073ae-0bba-4ef8-b797-34246d9bc052'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.167462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a821bf10ffb1420ea3ecff42f7355d42', 'request_id': 'req-d4a073ae-0bba-4ef8-b797-34246d9bc052'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.290517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a821bf10ffb1420ea3ecff42f7355d42', 'request_id': 'req-d4a073ae-0bba-4ef8-b797-34246d9bc052'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.304289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] The token cache is being invalidate because project a821bf10ffb1420ea3ecff42f7355d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:03.304578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.305240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.306783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1067/2132] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:02 2022] DELETE /identity/v3/projects/a821bf10ffb1420ea3ecff42f7355d42 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:03.312084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4186f9-a0d0-43dc-a2f2-5f1c31385dfb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.312424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4186f9-a0d0-43dc-a2f2-5f1c31385dfb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.312701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4186f9-a0d0-43dc-a2f2-5f1c31385dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.330325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.332098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.339480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ec4186f9-a0d0-43dc-a2f2-5f1c31385dfb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:03.341703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ec4186f9-a0d0-43dc-a2f2-5f1c31385dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.410253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a073ae-0bba-4ef8-b797-34246d9bc052 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:03.417761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:03.418604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.418776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.419011 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] PATH_INFO: `/v3/projects/a12c25819ac74fef8749a84f659c9ba9` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.423214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12c25819ac74fef8749a84f659c9ba9)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.426906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.527548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1066/2133] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:03.537893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.538272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.538613 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.565645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:03.567746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.573115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12c25819ac74fef8749a84f659c9ba9', 'request_id': 'req-4626d374-5957-4893-9895-3923ba52e133'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.580626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12c25819ac74fef8749a84f659c9ba9', 'request_id': 'req-4626d374-5957-4893-9895-3923ba52e133'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.637941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1067/2134] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:03.642293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.655971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2813980-5f43-4e93-adc6-d31e8db2c7dc None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:03.657893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:03.658517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.658802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.659079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.659837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:03.660171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.661795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.675708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1068/2135] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:19:03.680473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.690098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12c25819ac74fef8749a84f659c9ba9', 'request_id': 'req-4626d374-5957-4893-9895-3923ba52e133'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.691096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c6491-c946-4c13-abee-ab0d312f6931 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:03.696887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:03.697314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.697500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.697782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.698461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.700519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42cfa-f16d-4ad8-a46e-f0993db41cc4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.705228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] The token cache is being invalidate because project a12c25819ac74fef8749a84f659c9ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:03.705831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.706741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.713948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1068/2136] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:03 2022] DELETE /identity/v3/projects/a12c25819ac74fef8749a84f659c9ba9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:03.713948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.713948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.738251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626d374-5957-4893-9895-3923ba52e133 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:03.744256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:03.744927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.745213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.745491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] PATH_INFO: `/v3/projects/9dfc8c9f08c94b0e83340b7001db5d1a` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.746708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfc8c9f08c94b0e83340b7001db5d1a)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:03.749298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:03.833275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1069/2137] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:03.834732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:03.835070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:03.835309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:03.856567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:03.857811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.900038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfc8c9f08c94b0e83340b7001db5d1a', 'request_id': 'req-78f083ed-2dc4-44ce-966a-85b799203f7a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.908540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfc8c9f08c94b0e83340b7001db5d1a', 'request_id': 'req-78f083ed-2dc4-44ce-966a-85b799203f7a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:03.930103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1070/2138] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:03.930970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:03.932335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:03.945167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa350-8458-4e92-a035-081319cd91b8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.004634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfc8c9f08c94b0e83340b7001db5d1a', 'request_id': 'req-78f083ed-2dc4-44ce-966a-85b799203f7a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.007313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.008048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.008381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.008863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.009730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.011999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.017370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] The token cache is being invalidate because project 9dfc8c9f08c94b0e83340b7001db5d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:04.017669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.018327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-78f083ed-2dc4-44ce-966a-85b799203f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.019964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1069/2139] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:03 2022] DELETE /identity/v3/projects/9dfc8c9f08c94b0e83340b7001db5d1a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:04.021283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.021569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.022035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.044433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:04.045653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.054551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1070/2140] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:04.055460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.056864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.074997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865fad-ed94-4c61-83cf-db7c5bc4ee46 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.080092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.080757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.081034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.081304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] PATH_INFO: `/v3/users/b191da5e96b04cafacd3b4d6f827a229` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.082567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b191da5e96b04cafacd3b4d6f827a229)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.084707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.097344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1071/2141] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:03 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:04.097757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.112527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f12e2-fbad-42ff-a056-47013da0f4a9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.122248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.122903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.123232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.123516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.124337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:04.124654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.126404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.143978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1072/2142] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:04.145065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.147682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.164757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320d80-d1e1-4fc6-80be-3d2bc7bcacaf admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.170173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.170825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.171187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.171379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.172144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.173827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.186217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1073/2143] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:04.187182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.198783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76543d-34b1-4c2e-bbe4-1d9bf0fece94 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.204233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.205062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.205422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.205773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.206541 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.208669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.299242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b191da5e96b04cafacd3b4d6f827a229'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.300475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1074/2144] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:04 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:04.304914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.306757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b191da5e96b04cafacd3b4d6f827a229'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.306917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.307703 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b191da5e96b04cafacd3b4d6f827a229'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.308571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b191da5e96b04cafacd3b4d6f827a229'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.322056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b191da5e96b04cafacd3b4d6f827a229'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.374534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:04.379323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89de4-7db1-449b-804b-9a5eeba46f9d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.384952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.385620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.385897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.386179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] PATH_INFO: `/v3/users/a29d940aa5204573a88c371abc95706f` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.387414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29d940aa5204573a88c371abc95706f)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.389412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.553657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1071/2145] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:04 2022] DELETE /identity/v3/users/b191da5e96b04cafacd3b4d6f827a229 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:04.554814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.556234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.628300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429f56b-ef0f-4c30-a7e2-201802363368 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.634680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.635378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.635663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.635965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.636676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.638399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.649567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1072/2146] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:04.650782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.652835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.667291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b55340-48e2-4573-a4e9-30152451597b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.673211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.673839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.674121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.674396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.675067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.677187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.744828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29d940aa5204573a88c371abc95706f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.751973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29d940aa5204573a88c371abc95706f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.752772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29d940aa5204573a88c371abc95706f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.753668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:04.769530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29d940aa5204573a88c371abc95706f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.840486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1073/2147] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:04 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:04.841625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.843624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.859436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee50ec6-8d63-4e7f-bf3f-7ed3acb8c773 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.866540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.867566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.869071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.869485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29d940aa5204573a88c371abc95706f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:04.869596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] PATH_INFO: `/v3/projects/4d4e6306662c48288118048646104ca3/users/330f9f0be4434f9195ac453e5550ad29/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.876420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1075/2148] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:04 2022] DELETE /identity/v3/users/a29d940aa5204573a88c371abc95706f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:04.877554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.879074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:04.891070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e6306662c48288118048646104ca3, user_id=330f9f0be4434f9195ac453e5550ad29, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.895031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.949354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e7842-edbc-46b2-b4c9-d2438ad9919f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:04.954223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:04.954842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.955123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.955399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.956252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:04.957885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f63632-28f0-4073-8821-78d380ac4f25 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:04.968956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1076/2149] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:04.970450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0118-79b6-4af9-afbe-6e0824f799b5 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:04.970855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0118-79b6-4af9-afbe-6e0824f799b5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:04.971261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0118-79b6-4af9-afbe-6e0824f799b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:04.977677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1074/2150] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:04 2022] PUT /identity/v3/projects/4d4e6306662c48288118048646104ca3/users/330f9f0be4434f9195ac453e5550ad29/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:04.978688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:04.991038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c17b0118-79b6-4af9-afbe-6e0824f799b5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:04.992347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c17b0118-79b6-4af9-afbe-6e0824f799b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.072431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd177e4-ef0b-48bf-8775-b8741f773807 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.079121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.079879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.080420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.080688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1077/2151] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:05.080876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.081722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.082063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.082352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.082738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.084118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.096820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1075/2152] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:05.097893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.100402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.108975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:05.110206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.116178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569eea88-03af-46a4-aa71-7bdb8e48ba12 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.119304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1078/2153] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:05.121723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.125161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.138743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.139583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.140530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.140985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] PATH_INFO: `/v3/projects/8375cd55761b4a768fe5089c93b532be` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.143060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8375cd55761b4a768fe5089c93b532be)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.145705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.190718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a8380-64f5-4248-a951-16e9085feac4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.195172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.195797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.196109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.196384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.211513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.213042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.223778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1079/2154] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:05.224721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.239808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf45e7-bbf2-4515-82a4-011a1f308e9c service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.245547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.246957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.246957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.247176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] PATH_INFO: `/v3/projects/3bfcdbc6c49943cdbe20de4e829055fa/users/2b39f851aceb4b53af0330a4e65955b8/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.263957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8375cd55761b4a768fe5089c93b532be', 'request_id': 'req-625fa654-fdb7-43be-9693-cda530517c39'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:05.264621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfcdbc6c49943cdbe20de4e829055fa, user_id=2b39f851aceb4b53af0330a4e65955b8, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.267831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.272157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8375cd55761b4a768fe5089c93b532be', 'request_id': 'req-625fa654-fdb7-43be-9693-cda530517c39'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:05.393333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8375cd55761b4a768fe5089c93b532be', 'request_id': 'req-625fa654-fdb7-43be-9693-cda530517c39'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:05.409611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] The token cache is being invalidate because project 8375cd55761b4a768fe5089c93b532be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:05.409867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1080/2155] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:05 2022] PUT /identity/v3/projects/3bfcdbc6c49943cdbe20de4e829055fa/users/2b39f851aceb4b53af0330a4e65955b8/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:05.410248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:05.411411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-625fa654-fdb7-43be-9693-cda530517c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:05.413483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.418498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1076/2156] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:05 2022] DELETE /identity/v3/projects/8375cd55761b4a768fe5089c93b532be => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:05.418498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6886-1896-4e56-bdb5-f63a76e4cd5e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.418498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6886-1896-4e56-bdb5-f63a76e4cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.419324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6886-1896-4e56-bdb5-f63a76e4cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.421526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.433845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:05.452228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-9a4a6886-1896-4e56-bdb5-f63a76e4cd5e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:05.454201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9a4a6886-1896-4e56-bdb5-f63a76e4cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.563536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723217-82a3-42ef-8ffd-01db14a326ef admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.570585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.572300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.572747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.573494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.575804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.607852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1077/2157] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:05.610074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc15be-a272-4748-a278-2606476d09ec None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.610660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc15be-a272-4748-a278-2606476d09ec None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.611144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc15be-a272-4748-a278-2606476d09ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.646376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-aafc15be-a272-4748-a278-2606476d09ec None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:05.648830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-aafc15be-a272-4748-a278-2606476d09ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.670834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1078/2158] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:05.670834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc15be-a272-4748-a278-2606476d09ec None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.671109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.671109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb8e1-00b7-49d4-b745-8e95df0a2e0b service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.681063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc15be-a272-4748-a278-2606476d09ec None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.684217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1081/2159] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:05.685374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.685525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.685791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.686051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.686175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.686335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.686549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.698634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.700454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.709080 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:05.711270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.712847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1079/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:05.719861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1082/2161] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:05.726266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.742335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc6f1e-bcb1-40b9-b281-df699c68ef3c service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.748036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.748709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.748994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.749275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.749971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:05.750284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.752048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.765491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1080/2162] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:05.769876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.779951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.780239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:05.789942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935723c-b0b1-4c6f-aeb6-608ce8c17d42 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.795185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.795707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.796020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.796296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.804521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.804638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3ec90-1391-445c-aeba-33aad86931c4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:05.804751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.806208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:05.806867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:05.807143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:05.807418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] PATH_INFO: `/v3/users/809fb377331f4ad097b7e02b163bf27c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:05.808927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809fb377331f4ad097b7e02b163bf27c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:05.810871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:05.972562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1083/2163] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:05.972562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:05.972996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.023143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:06.051496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91e4f5-a2bb-420c-b2cd-63e7b88491b1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.057375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.058026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.058316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.058592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] PATH_INFO: `/v3/projects/73512b39b333480589f4204844a94376` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.059925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73512b39b333480589f4204844a94376)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.061815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.066591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809fb377331f4ad097b7e02b163bf27c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.075208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809fb377331f4ad097b7e02b163bf27c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.076968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809fb377331f4ad097b7e02b163bf27c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.080659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809fb377331f4ad097b7e02b163bf27c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.092959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809fb377331f4ad097b7e02b163bf27c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.170708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1081/2164] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:05 2022] DELETE /identity/v3/users/809fb377331f4ad097b7e02b163bf27c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:06.172411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.177224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.202725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73512b39b333480589f4204844a94376', 'request_id': 'req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.212712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73512b39b333480589f4204844a94376', 'request_id': 'req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.270665 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba4ad-052b-4843-95a5-39aab00495e8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.281002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.281593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.281875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.282291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.283037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.285048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4120-d788-4450-a7ef-005b8ff003cc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.295638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73512b39b333480589f4204844a94376', 'request_id': 'req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.309407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] The token cache is being invalidate because project 73512b39b333480589f4204844a94376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:06.309711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.311132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9417f1c2-2c2f-4ced-8bbe-37592851d8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:06.312816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1084/2165] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:05 2022] DELETE /identity/v3/projects/73512b39b333480589f4204844a94376 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:06.316376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5c2f-4420-4008-af1f-46aab582c780 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.316376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5c2f-4420-4008-af1f-46aab582c780 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.316376 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5c2f-4420-4008-af1f-46aab582c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.338355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-517d5c2f-4420-4008-af1f-46aab582c780 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:06.339587 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-517d5c2f-4420-4008-af1f-46aab582c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.348132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1085/2166] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:06.349468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.350311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.351206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.372572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:06.373816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.382507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1086/2167] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:06.383467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.384933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.398859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1082/2168] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:06.400800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.401088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.401367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.423789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:06.425052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.436876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1083/2169] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:06.438143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.439826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.453427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b2ba-7b08-4565-aafb-f4a9576072c0 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.455114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc742-dc15-4bdd-85a7-f08fcfd0659f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.458142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.458879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.459383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.459684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.459818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.460506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.460879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.460993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.461169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.462503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.472287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.474332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.484242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1084/2170] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:06.485439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.491035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:06.497663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e011ddf-c691-401a-a47f-723152261a27 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.497855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1087/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:06.501473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.503194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.504004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.504294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.504624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.505544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:06.505747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.508037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.513964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801862fe-008e-4ad8-83ac-206a73799a05 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.528935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1085/2172] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:06.530499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.531980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.532759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.532915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.533368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.534285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.536258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.545630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f8e1-ad6c-4b51-85e2-120d606a791c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.551138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1088/2173] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:06.554052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.554809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.555307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.556041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.556854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.557525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.560058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.578773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c772ee0-0390-45ae-821b-d920bd9b2367 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.585184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.586038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.586303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.586628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] PATH_INFO: `/v3/projects/4d268e3cdce148e09f18d12f049b9504/users/a11ef1d205954752be19ce79633b1cf3/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.610348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d268e3cdce148e09f18d12f049b9504, user_id=a11ef1d205954752be19ce79633b1cf3, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.613609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c5ab-7dbd-474e-bfa9-e967ea97cb30 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.726311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1089/2174] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:06 2022] PUT /identity/v3/projects/4d268e3cdce148e09f18d12f049b9504/users/a11ef1d205954752be19ce79633b1cf3/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:06.728140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1086/2175] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:06.742966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.749540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.749831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.750111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.787728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] MFA Rules not processed for user `a11ef1d205954752be19ce79633b1cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:06.791976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.848031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee95da-faf2-4040-ae9a-e82f44c15f97 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.856620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.857639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.858071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.858497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:06.860163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:06.863151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:06.892745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1090/2176] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:06.901967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:06.903735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:06.978573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fe604-4ab7-4ddf-9724-3d3537eb40b3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:06.986432 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:06.987503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:06.987990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:06.988406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.004252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.004252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.026401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1087/2177] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:06 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:07.027861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1091/2178] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:07.029742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.045600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b05b6-457a-49e7-9aaf-00f6658b5f2a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.052926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.054650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.054838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.056438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.056438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.059599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.070390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.073622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394d25d-64e2-48d5-b74e-c45bd4691c58 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.087077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.087589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:07.093952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.093952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.093952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] PATH_INFO: `/v3/users/a11ef1d205954752be19ce79633b1cf3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.093952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11ef1d205954752be19ce79633b1cf3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.097601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1088/2179] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:07.097716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.098736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.112941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c408acc-d452-4d2a-a359-4f454cf6b357 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.121947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.122966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.123269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.123584 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.124457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.126239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.154201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1089/2180] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:07.156053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.171974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe435-bf99-46c0-ac8a-963d4f21374e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.177352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.178115 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.178399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.178677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] PATH_INFO: `/v3/projects/6e83facca3f744c8b07447dfe9bc511c/users/defd6fe1fb9d4caabff6064e53be5e89/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.194737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83facca3f744c8b07447dfe9bc511c, user_id=defd6fe1fb9d4caabff6064e53be5e89, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.197672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.318420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1090/2181] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:07 2022] PUT /identity/v3/projects/6e83facca3f744c8b07447dfe9bc511c/users/defd6fe1fb9d4caabff6064e53be5e89/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:07.319819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.321953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.367719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11ef1d205954752be19ce79633b1cf3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.376092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11ef1d205954752be19ce79633b1cf3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.377291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11ef1d205954752be19ce79633b1cf3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.393813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11ef1d205954752be19ce79633b1cf3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.418823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077688-bd15-421e-8a91-13001ee19f3b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.425057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.425720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.425999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.426275 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] PATH_INFO: `/v3/projects/e6ddb1ed230445de82f597721ecd29ae` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.427476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ddb1ed230445de82f597721ecd29ae)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.429640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.461492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-739d383c-f877-4bdd-bb48-6069a5ca9693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11ef1d205954752be19ce79633b1cf3'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.468002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1092/2182] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:07 2022] DELETE /identity/v3/users/a11ef1d205954752be19ce79633b1cf3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:07.469281 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b562-9985-4627-b223-455fea5290b2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.469566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b562-9985-4627-b223-455fea5290b2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.469871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7b562-9985-4627-b223-455fea5290b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.490134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-aca7b562-9985-4627-b223-455fea5290b2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:07.491494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-aca7b562-9985-4627-b223-455fea5290b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.540529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ddb1ed230445de82f597721ecd29ae', 'request_id': 'req-70dc50a3-9813-417a-a20e-ff31e93d6fa0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.548143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ddb1ed230445de82f597721ecd29ae', 'request_id': 'req-70dc50a3-9813-417a-a20e-ff31e93d6fa0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.556233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1093/2183] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:07.557716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.558010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.558320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.577426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:07.583871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.640032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1094/2184] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:07.641005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.642425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.651554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ddb1ed230445de82f597721ecd29ae', 'request_id': 'req-70dc50a3-9813-417a-a20e-ff31e93d6fa0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.670776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] The token cache is being invalidate because project e6ddb1ed230445de82f597721ecd29ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:07.672141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.673440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:07.676261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1091/2185] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:07 2022] DELETE /identity/v3/projects/e6ddb1ed230445de82f597721ecd29ae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:07.679260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.682541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.721826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f9b8-28de-4413-9ff3-6aa891eb6ae5 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.724539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.725937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.726226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.726507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.733901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.757873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.759598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.772551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1095/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:07.773237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.775139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.788980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd196cd-b61d-4122-96c7-bd7bd82d8112 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.794372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.795037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.795322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.795601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] PATH_INFO: `/v3/users/ed694927435641369f080c4f09d6519c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.796867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed694927435641369f080c4f09d6519c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.799036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.816443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc50a3-9813-417a-a20e-ff31e93d6fa0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:07.822578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:07.823225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.823510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.823789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.825761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.842858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:07.844348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad97cde-08be-42f9-9304-cf9fdbab7f08 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:07.855631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1092/2187] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:07.856797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:07.857111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:07.857367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:07.885672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:07.894438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] MFA Rules not processed for user `2b39f851aceb4b53af0330a4e65955b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:07.895763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:07.984935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1093/2188] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:07.988786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:07.991405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:08.011820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab7085-7f3f-4e53-b80f-0b8856db0bd6 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.017852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.018738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.019116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.019563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.021000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.025390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.064254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed694927435641369f080c4f09d6519c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:08.074022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed694927435641369f080c4f09d6519c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:08.075104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed694927435641369f080c4f09d6519c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:08.092266 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed694927435641369f080c4f09d6519c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:08.148647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1094/2189] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:07 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:08.153879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.157805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:08.188970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed694927435641369f080c4f09d6519c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:08.205274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1096/2190] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:07 2022] DELETE /identity/v3/users/ed694927435641369f080c4f09d6519c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:08.256737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bc0fa-dbec-4b24-b938-59f37edd1206 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.336610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.337418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.337800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.338174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.339479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.341909 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.468120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1095/2191] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:08 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:08.472155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.485119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2e34-2a30-4072-8c23-da6cf6756c1f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.492683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.493494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.493930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.494536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.495394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.499761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.513107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1097/2192] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:08.517953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.531582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face05d-5332-4a21-9151-0a21cca83a14 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.539662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.540643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.541149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.541491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] PATH_INFO: `/v3/projects/5df3b08df9444b4fa47f31f981c645e5/users/8a06e37b9da34e69b6a1a5f6fa5ee98f/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.580914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df3b08df9444b4fa47f31f981c645e5, user_id=8a06e37b9da34e69b6a1a5f6fa5ee98f, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.584776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.674912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1096/2193] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:08 2022] PUT /identity/v3/projects/5df3b08df9444b4fa47f31f981c645e5/users/8a06e37b9da34e69b6a1a5f6fa5ee98f/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:08.680443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.719562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd3366-0e38-498e-bcc1-8b90fba3b9c1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.812344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.814569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.815427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.817167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.818062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.820239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.836986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1098/2194] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:08.852681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.866723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b95c-ad2a-496b-a183-6068d22bdb13 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.875119 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:08.877327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:08.877327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:08.877327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] PATH_INFO: `/v3/projects/5df3b08df9444b4fa47f31f981c645e5/users/8a06e37b9da34e69b6a1a5f6fa5ee98f/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:08.879436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df3b08df9444b4fa47f31f981c645e5, user_id=8a06e37b9da34e69b6a1a5f6fa5ee98f, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:08.880578 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:08.883496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:08.884241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d8cb-52cd-43ad-89ce-35e83f0c5651 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:08.900505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1097/2195] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:08 2022] PUT /identity/v3/projects/5df3b08df9444b4fa47f31f981c645e5/users/8a06e37b9da34e69b6a1a5f6fa5ee98f/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:08.909858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79330a3-8664-47cf-a280-ce7eb1773fb8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:08.953544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:09.018648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:09.019509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.019861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.021882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] PATH_INFO: `/v3/projects/4d268e3cdce148e09f18d12f049b9504` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.023497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d268e3cdce148e09f18d12f049b9504)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:09.027817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:09.223222 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d268e3cdce148e09f18d12f049b9504', 'request_id': 'req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.233980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d268e3cdce148e09f18d12f049b9504', 'request_id': 'req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.319162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d268e3cdce148e09f18d12f049b9504', 'request_id': 'req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.347364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] The token cache is being invalidate because project 4d268e3cdce148e09f18d12f049b9504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:09.347648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.349350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.353394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1099/2196] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:08 2022] DELETE /identity/v3/projects/4d268e3cdce148e09f18d12f049b9504 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:09.359882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5b885-6732-47e4-9098-03c83c3b1a10 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.361475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5b885-6732-47e4-9098-03c83c3b1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.362079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5b885-6732-47e4-9098-03c83c3b1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.380282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:09.383377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.412644 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:09.421379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f1c5b885-6732-47e4-9098-03c83c3b1a10 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:09.426959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f1c5b885-6732-47e4-9098-03c83c3b1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.535007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e11d44-7df3-484e-b9f4-ff2ad9e1def6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:09.543967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:09.545002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.545471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.545933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] PATH_INFO: `/v3/projects/b64104ca36cc4efa8831e87275d8df0c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.547399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64104ca36cc4efa8831e87275d8df0c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:09.549800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:09.624281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1098/2197] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:09.634684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.635223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.635510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.660481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:09.661741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.674407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1099/2198] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:09.683389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:09.696096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64104ca36cc4efa8831e87275d8df0c', 'request_id': 'req-fff1d3df-06e3-4641-8409-97f6264c725c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.705255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c41e-eba2-48b8-b2a2-f1145dd4a866 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:09.705582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64104ca36cc4efa8831e87275d8df0c', 'request_id': 'req-fff1d3df-06e3-4641-8409-97f6264c725c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.789359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:09.790052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.790336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.790617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.792802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:09.793012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:09.794863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:09.813535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1100/2199] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:09.820685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:09.833850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e601-8a14-4110-b2f0-68393f0c2789 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:09.841322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:09.842095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.842401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.842772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.843661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:09.845876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:09.892770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64104ca36cc4efa8831e87275d8df0c', 'request_id': 'req-fff1d3df-06e3-4641-8409-97f6264c725c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.914476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] The token cache is being invalidate because project b64104ca36cc4efa8831e87275d8df0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:09.915554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.916699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fff1d3df-06e3-4641-8409-97f6264c725c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:09.918553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1100/2200] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:09 2022] DELETE /identity/v3/projects/b64104ca36cc4efa8831e87275d8df0c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:09.923526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0264-d9e2-4301-942a-48235002abb2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:09.924105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0264-d9e2-4301-942a-48235002abb2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:09.924557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef0264-d9e2-4301-942a-48235002abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:09.951653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-abef0264-d9e2-4301-942a-48235002abb2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:09.956214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1101/2201] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:09.957751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-abef0264-d9e2-4301-942a-48235002abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:09.960646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:09.962508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:10.062179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1101/2202] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:10.080204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.080969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.081513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.093129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e26762-9d96-44ed-ad07-26cb6b04a8b8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.112510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.113516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.113987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.114403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.116307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.118592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.129249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:10.130736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:10.144044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1102/2203] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:10.146663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.157780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294e6d7-de44-4399-8e08-db0ef6a3b7cc None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.163531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.164194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.164475 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.164748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.165610 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:10.165920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.167580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.190350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1103/2204] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:19:10.195199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.219868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1102/2205] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:09 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:10.220393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5a576-0c00-40cb-aa7a-1cd9a5deb737 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.221229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.222940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.229337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.229637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.229918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.230625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.232736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.241459 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5d28-ef41-4d7a-a730-0f548b9c8362 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.251423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.254133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.254133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.254133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.254133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.255207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.277116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1103/2206] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:10.280824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.295070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381c1d-ed05-45e8-bf84-bd56c078636e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.304226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.309006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.309529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.310856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.312324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.316150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.331361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1104/2207] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:10.338610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.364544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1104/2208] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:10 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:10.369477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.379978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa64685-0db3-4932-b47c-03fad0bfaabc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.492362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6f89c-4917-4e85-90d2-d07aa9ebdbf8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.500061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.501200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.501881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.502323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.503828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.509769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.516666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.517372 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.517661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.517939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] PATH_INFO: `/v3/projects/2da6c83af3bf447497f2ca371b4dab20/users/f477a01089d6429faaf977381e4b4eba/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.542950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da6c83af3bf447497f2ca371b4dab20, user_id=f477a01089d6429faaf977381e4b4eba, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.546086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669655a-7220-4503-92de-a68109db91e2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.635684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1105/2210] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:10 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:10.637276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1105/2210] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:10 2022] PUT /identity/v3/projects/2da6c83af3bf447497f2ca371b4dab20/users/f477a01089d6429faaf977381e4b4eba/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:10.639411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.639411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.639840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.656651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.685969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153637ae-be25-4853-a0ec-54fd77922e65 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.701024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] MFA Rules not processed for user `f477a01089d6429faaf977381e4b4eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:10.705399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:10.847181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.848166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.848597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.849156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.855622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.857695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.871338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1106/2211] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:10.871996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:10.879245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.882241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:10.894386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1106/2212] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:10.899263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:10.930352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53369e6-9e16-442d-851e-5cf272b1ee8e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:10.950646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:10.951349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:10.951790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:10.955017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:10.955770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:10.957789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:10.989093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1107/2213] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:11.001320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:11.027520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f467983-52eb-483a-92b2-fb4664581d08 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:11.033627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:11.034535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.034969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.035424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] PATH_INFO: `/v3/projects/d5b5658fe6954586ac8183a1f98166a9/users/9ffd0dad58824c87bf12016fc3c9ae7c/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.053125 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b5658fe6954586ac8183a1f98166a9, user_id=9ffd0dad58824c87bf12016fc3c9ae7c, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:11.056349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62360200-ec51-4edd-856a-0f66de4efaa1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:11.070327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266dbf-1ca9-4097-9846-1fd67ce6a6da None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:11.080031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:11.080701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.080963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.081233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.097878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:11.099339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016835-7b60-45af-be5c-6f8c147ab069 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:11.121568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1107/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:11.164036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1108/2215] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:10 2022] PUT /identity/v3/projects/d5b5658fe6954586ac8183a1f98166a9/users/9ffd0dad58824c87bf12016fc3c9ae7c/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:11.174084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.174519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.175006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.231863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8400-4b00-45a6-8d83-2da5de0cb2c4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.236759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8400-4b00-45a6-8d83-2da5de0cb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.236759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8400-4b00-45a6-8d83-2da5de0cb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.249324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] MFA Rules not processed for user `9ffd0dad58824c87bf12016fc3c9ae7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:11.251776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:11.285351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:11.290602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b78b8400-4b00-45a6-8d83-2da5de0cb2c4 None None] MFA Rules not processed for user `8a06e37b9da34e69b6a1a5f6fa5ee98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:11.293010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b78b8400-4b00-45a6-8d83-2da5de0cb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:11.387692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1108/2216] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:11.392150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:11.420489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1109/2217] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:11.432410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.432637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.432911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.471943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] MFA Rules not processed for user `2b39f851aceb4b53af0330a4e65955b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:11.475602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:11.513473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c7b8f-d602-4ff6-ad56-17553d76c0c8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:11.518727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:11.519422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.519780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.520094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.523447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:11.523766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:11.610326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1110/2218] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:11.624670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:11.627406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1109/2219] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:11.630276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:11.632130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:11.814390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377346d-96d6-4d88-8966-1706d5982430 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:11.829282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:11.832771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.834127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.834611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.837590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:11.838278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a3805-a65c-4fae-a470-0190896b777c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:11.844852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:11.973433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:11.978063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:11.978063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:11.978063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:11.981271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.006650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1110/2220] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:11 2022] POST /identity/v3/users => generated 299 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:12.011331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.032843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a326-7291-4509-95f7-d50fe2be14e8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.055737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.056646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.057315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.057315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.058193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.061707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.088878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1111/2221] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:12.093326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.119505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446878d-43bf-4707-8d7f-ce4cc19336bc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.132903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.133880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.136078 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.136510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] PATH_INFO: `/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d/users/56fbd75701cf4aad920407fc0ff01aed/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.136752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.140461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.184875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d478fd8dd548dd9bbbd8c72509924d, user_id=56fbd75701cf4aad920407fc0ff01aed, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.191253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.200439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1111/2222] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:12.327067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1112/2223] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:12 2022] PUT /identity/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d/users/56fbd75701cf4aad920407fc0ff01aed/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:12.332875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.349065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a9e3-e6f9-4c60-9874-4a09b628d60a service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.469107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.470075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.470553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.471712 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.472975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.480498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa9b8-eb3c-49f8-82e3-638f2734ad4b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.497358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1112/2224] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:12.500483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.516711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8844-5b5c-4a9d-af81-0f09a8ac1b9e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.523291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.524427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.525252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.525724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] PATH_INFO: `/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d/users/56fbd75701cf4aad920407fc0ff01aed/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.528664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d478fd8dd548dd9bbbd8c72509924d, user_id=56fbd75701cf4aad920407fc0ff01aed, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:12.532143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:12.548462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1113/2225] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:12 2022] PUT /identity/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d/users/56fbd75701cf4aad920407fc0ff01aed/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:12.565577 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32c35-4f12-4539-a8eb-64f51b153aa3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.565869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32c35-4f12-4539-a8eb-64f51b153aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.566486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec32c35-4f12-4539-a8eb-64f51b153aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:12.635665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-eec32c35-4f12-4539-a8eb-64f51b153aa3 None None] MFA Rules not processed for user `56fbd75701cf4aad920407fc0ff01aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:12.637448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eec32c35-4f12-4539-a8eb-64f51b153aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.822492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1113/2226] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:12.836325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:12.839450 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:12.926238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45209e2-cb7b-49b3-a41f-4d31e3de4bee admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:12.932435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:12.933436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:12.933930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:12.934415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:13.028490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:13.033410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:13.064497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1114/2227] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:13.175629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:13.553967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:15.012256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:15.012755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:15.012858 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:15.051645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] MFA Rules not processed for user `330f9f0be4434f9195ac453e5550ad29`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:15.081873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:15.118751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:15.389348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1114/2228] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:15.503984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:15.541287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:15.542942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:15.704741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f5a-a544-4a07-b0e6-770e739f42f7 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:15.722835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911e947-0d74-49a6-9f75-c142e86b5dd7 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:15.722934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:15.723490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:15.723789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:15.724069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:15.735501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:15.736456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:15.736623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:15.737042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] PATH_INFO: `/v3/users/8eda886ddaf84c43b298929b438fda6e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:15.738506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eda886ddaf84c43b298929b438fda6e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:15.741813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:15.742956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:15.744653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831b380-21d7-45c0-89ce-8ed892fb562c service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:15.767334 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1115/2229] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:16.059687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eda886ddaf84c43b298929b438fda6e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:16.073734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eda886ddaf84c43b298929b438fda6e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:16.074657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eda886ddaf84c43b298929b438fda6e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:16.093397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eda886ddaf84c43b298929b438fda6e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:16.176416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eda886ddaf84c43b298929b438fda6e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:16.187772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1115/2230] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:15 2022] DELETE /identity/v3/users/8eda886ddaf84c43b298929b438fda6e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:16.192369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:16.192683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:16.193169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:16.214326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:16.215676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:16.314145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1116/2231] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:16.327563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:16.329615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:16.415506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:16.460647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0e5a-377e-4e2d-a6eb-9c8c8534a469 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:16.464693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:16.465341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:16.465802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:16.466253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:16.494583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:16.496163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ea9a9-638d-4908-b7a2-52aaf828604a service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:16.515784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1116/2232] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:16.949219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:18.089212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:18.091820 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:18.117802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3762-4f3f-4169-8838-ca74c483c156 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:18.126189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:18.126892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:18.127220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:18.127537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] PATH_INFO: `/v3/projects/65f08a2f159c40be8236277ba2529885` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:18.129757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f08a2f159c40be8236277ba2529885)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:18.132364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:18.320272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f08a2f159c40be8236277ba2529885', 'request_id': 'req-1812c8de-96a1-4aac-89e0-ac96962ecf5f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:18.340717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f08a2f159c40be8236277ba2529885', 'request_id': 'req-1812c8de-96a1-4aac-89e0-ac96962ecf5f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:18.473532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f08a2f159c40be8236277ba2529885', 'request_id': 'req-1812c8de-96a1-4aac-89e0-ac96962ecf5f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:18.502591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] The token cache is being invalidate because project 65f08a2f159c40be8236277ba2529885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:18.503129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:18.505025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1812c8de-96a1-4aac-89e0-ac96962ecf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:18.509666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1117/2233] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:18 2022] DELETE /identity/v3/projects/65f08a2f159c40be8236277ba2529885 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:18.515378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:18.516199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:18.516681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:18.558162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:18.559411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:18.895614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:18.895935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:18.896458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:18.896958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1117/2234] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:18.945088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:18.946324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:18.962607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1118/2235] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:18.971333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:18.982558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822245d-6443-471c-a86e-a2df0da25796 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:18.996019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:18.996948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:18.997413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:18.998017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.005195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:19.005195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.005195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.028342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1118/2236] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:19.032931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:19.054756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159aa3-d1b8-4a30-b2c6-df9abe27ed12 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:19.072032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:19.074888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.075400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.076354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.078544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.082047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.095756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:19.229048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1119/2237] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:19 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:19.234291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:19.250820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29eeef-2d32-41c4-9c21-3a4be70af4ef admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:19.381291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:19.382981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.384257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.388047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.389143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.392296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.478832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:19.507000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1119/2238] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:19 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:19.508026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:19.535983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939971b-854c-415d-8139-eb57cffb55a6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:19.557842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:19.558745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.559202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.559619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.560548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.562455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.579988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1120/2239] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:19.581696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:19.598043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f2201-7ace-4e64-a7e5-f025f3dab26a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:19.628731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:19.631152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.631152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.631152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.633128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.634994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b9311-9620-4845-84fe-42d67e2686ba admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.680219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1120/2240] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:19.684667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:19.699835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bdff-d1e7-43c1-8133-fbb6fd3301ac admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:19.719401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:19.720188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.720587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.720745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] PATH_INFO: `/v3/projects/62810edbb50e4ddd8e0dc6834ffff1ec/users/125892d80a1d4844aac220b76b3bc495/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.759485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62810edbb50e4ddd8e0dc6834ffff1ec, user_id=125892d80a1d4844aac220b76b3bc495, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:19.762365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:19.858337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1121/2241] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:19 2022] PUT /identity/v3/projects/62810edbb50e4ddd8e0dc6834ffff1ec/users/125892d80a1d4844aac220b76b3bc495/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:19.871652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdee8a-b011-4a9d-8cd7-b9d48fef39ed None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:19.873102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdee8a-b011-4a9d-8cd7-b9d48fef39ed None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:19.873450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdee8a-b011-4a9d-8cd7-b9d48fef39ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:19.919633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6fbdee8a-b011-4a9d-8cd7-b9d48fef39ed None None] MFA Rules not processed for user `125892d80a1d4844aac220b76b3bc495`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:19.921207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6fbdee8a-b011-4a9d-8cd7-b9d48fef39ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:20.010613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.016123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1121/2242] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:20.074676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.074965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.075249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.096779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277294ab-9ac4-44aa-8e91-1f19c05645bb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.103558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.104226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.104683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.105146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.106085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.110167 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6c157-51c0-4934-a37a-36059e2e8c68 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.123267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] MFA Rules not processed for user `defd6fe1fb9d4caabff6064e53be5e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:20.125171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:20.220971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1122/2243] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:20.226882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.227173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.227549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.270579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] MFA Rules not processed for user `330f9f0be4434f9195ac453e5550ad29`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:20.272870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:20.308339 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1122/2244] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:20.311055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.328743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20969b7-862b-42bc-a9e8-1a81a346635c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.383570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1123/2245] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:20.383570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.391341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:20.494375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.496073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.499072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.499593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.500583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.509551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.524171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78d05a-c731-42b1-85d1-778f49105a31 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.532669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.534023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.534516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.535040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.536519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.541536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.644953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1123/2246] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:20.646855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1124/2247] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:20.652809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.665684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.695975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b4592-43a5-473a-983a-2e4edb8db80e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.794902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916cae7-63e3-41bf-b45f-ea6599ec3f78 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.814783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.815029 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.815278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.815467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.816182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.819846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.833461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.833861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.834110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.834408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.835534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.837893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.846118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1125/2248] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:20.852532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.893188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de250-0d95-4f96-b783-1bd9fe4079e6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.911214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:20.915273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:20.915598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:20.915872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:20.918345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:20.922987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:20.960913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1126/2249] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:20.965875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.983943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1124/2250] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:20 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:20.984754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:20.991477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:20.992352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0dc-d424-420e-8f05-f4c0e56901ab admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:20.999797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.001880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.002412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.002967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] PATH_INFO: `/v3/projects/00625438ed38465c80896f0cdf7440c6/users/991ca555c6944945a5a966630701f850/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.040655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00625438ed38465c80896f0cdf7440c6, user_id=991ca555c6944945a5a966630701f850, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.045850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.159946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04749e-5253-4f84-a9df-1a26a999e27b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:21.172354 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.173599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.174320 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.174705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.183802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:21.192825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1127/2251] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:20 2022] PUT /identity/v3/projects/00625438ed38465c80896f0cdf7440c6/users/991ca555c6944945a5a966630701f850/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:21.194336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:21.270040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:21.336225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.338401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965b537-4ec1-40f8-a706-245aa0876b24 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.356408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1125/2252] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:21.358245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.358792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.359324 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.402362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc1fa3-7219-414e-8944-09ad764ab292 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:21.404965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] MFA Rules not processed for user `991ca555c6944945a5a966630701f850`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:21.407606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:21.417699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.418332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.418615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.418891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.419608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.428226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.456402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1128/2253] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:21.458465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:21.461195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:21.490603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:21.494433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148072e-7c7f-433b-be09-6403f286e955 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:21.511739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.512515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.512799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.513074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] PATH_INFO: `/v3/users/f477a01089d6429faaf977381e4b4eba` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.516386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f477a01089d6429faaf977381e4b4eba)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.522687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.547352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1126/2254] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:21.548999 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:21.564961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a905a2-edea-4031-92d4-af88cc9cbb9c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:21.580765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.581668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.582025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.582378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] PATH_INFO: `/v3/projects/177f7b3b868a442a9ff6d8884c060811/users/7e21017ce5a6462da558939c934801d5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.608459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] RBAC: Authorizing `identity:create_grant(project_id=177f7b3b868a442a9ff6d8884c060811, user_id=7e21017ce5a6462da558939c934801d5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.612059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.717078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1127/2255] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:21 2022] PUT /identity/v3/projects/177f7b3b868a442a9ff6d8884c060811/users/7e21017ce5a6462da558939c934801d5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:21.718923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:21.831793 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f477a01089d6429faaf977381e4b4eba'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:21.866136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06114-c66f-49e1-80e7-44270efb940d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:21.871470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f477a01089d6429faaf977381e4b4eba'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:21.874036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:21.875001 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:21.875640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:21.876444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f477a01089d6429faaf977381e4b4eba'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:21.877201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:21.877700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f477a01089d6429faaf977381e4b4eba'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:21.878756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:21.884840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fb961-d53d-4a0a-9bd9-50359a2ae251 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:21.912935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f477a01089d6429faaf977381e4b4eba'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:22.073629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1128/2257] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:21 2022] POST /identity/v3/projects => generated 383 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:22.074855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1129/2257] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:21 2022] DELETE /identity/v3/users/f477a01089d6429faaf977381e4b4eba => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:22.077154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.087719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:22.089928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.090223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.090507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.124634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:22.125716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:22.245375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa49d93-7e10-471b-bda0-4a194bb38998 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.324112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1129/2258] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:22.324979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.326398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:22.343959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.345060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.346333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36541a71-f841-4b2b-9915-a1b2500a3212 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.346848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.347663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.348611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.355747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.370441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.371102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.371490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.371746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.372396 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.381950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.393267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1130/2259] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:22.398442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.416685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:22.503068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1130/2260] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:22 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:22.504201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.533231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf69f6-35dd-40cc-8292-afaf021d4b3d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.549476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.551516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.551804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.552111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] PATH_INFO: `/v3/projects/177f7b3b868a442a9ff6d8884c060811/users/7e21017ce5a6462da558939c934801d5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.563548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177f7b3b868a442a9ff6d8884c060811, user_id=7e21017ce5a6462da558939c934801d5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.575687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.615826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1131/2261] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:22 2022] PUT /identity/v3/projects/177f7b3b868a442a9ff6d8884c060811/users/7e21017ce5a6462da558939c934801d5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:22.615826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.671267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54015f5-5dd3-413c-8f8c-6db323b55719 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.805472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f3d4-6bbc-434a-a902-f6bdd2e279e3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.814187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.817857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.817857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.817857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.819179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.820907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.855189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1132/2262] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:22.860545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:22.887112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d87a1-ed84-48b4-8772-66d5d283037f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:22.892648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.893793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.894083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.894364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] PATH_INFO: `/v3/projects/6321873c3db94319ba2c6fee5f512dab/users/7185109e42204c2897e8f03b63e03a35/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.938044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:22.940889 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:22.942494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:22.943879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:22.944668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6321873c3db94319ba2c6fee5f512dab, user_id=7185109e42204c2897e8f03b63e03a35, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.953628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.972612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:22.977686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:22.996486 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1131/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:23.098747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:23.105100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1133/2264] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:22 2022] PUT /identity/v3/projects/6321873c3db94319ba2c6fee5f512dab/users/7185109e42204c2897e8f03b63e03a35/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:23.109789 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:23.168970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92363f1-b7ef-4b71-b2db-7fdab7bc2db5 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:23.530250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:23.531739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:23.532261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:23.532924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:23.533929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:23.537400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc3f5a-dcd7-4281-aa17-0af773224761 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:23.538809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:23.570103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1132/2265] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:23.573933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:23.591177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8df46-6a62-46e0-b8b8-9c1d0f2536ba admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:23.610071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:23.611565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:23.612301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:23.613016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] PATH_INFO: `/v3/projects/6321873c3db94319ba2c6fee5f512dab/users/7185109e42204c2897e8f03b63e03a35/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:23.639765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6321873c3db94319ba2c6fee5f512dab, user_id=7185109e42204c2897e8f03b63e03a35, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:23.657883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:23.720448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1134/2266] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:23 2022] PUT /identity/v3/projects/6321873c3db94319ba2c6fee5f512dab/users/7185109e42204c2897e8f03b63e03a35/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:23.732442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:23.732726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:23.733172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:23.784884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] MFA Rules not processed for user `7185109e42204c2897e8f03b63e03a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:23.786171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:23.963071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:23.964787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:24.039691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1133/2267] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:24.053847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:24.056559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:24.194920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa74da-37a1-46a5-8602-a85a852b0776 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:24.197028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559568-3130-41f2-a7d3-1d646cd689c7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:24.205476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:24.210135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.210425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.211442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.214455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:24.215526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.217105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:24.217811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.218109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] PATH_INFO: `/v3/projects/2da6c83af3bf447497f2ca371b4dab20` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.220681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da6c83af3bf447497f2ca371b4dab20)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:24.225406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:24.327460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:24.331160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad7f10-ae7c-4b4f-8625-6298f8bf6c4b service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:24.349764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1134/2268] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:24.414019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da6c83af3bf447497f2ca371b4dab20', 'request_id': 'req-d48f4248-0b39-489b-b462-77dc6141bccb'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:24.449549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da6c83af3bf447497f2ca371b4dab20', 'request_id': 'req-d48f4248-0b39-489b-b462-77dc6141bccb'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:24.516136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da6c83af3bf447497f2ca371b4dab20', 'request_id': 'req-d48f4248-0b39-489b-b462-77dc6141bccb'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:24.545548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] The token cache is being invalidate because project 2da6c83af3bf447497f2ca371b4dab20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:24.545911 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:24.547098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-d48f4248-0b39-489b-b462-77dc6141bccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:24.555048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1135/2269] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:23 2022] DELETE /identity/v3/projects/2da6c83af3bf447497f2ca371b4dab20 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:24.556920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.557419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.557513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.581671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:24.583505 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:24.660592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1135/2270] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:19:24.663306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.663716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.664084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.741618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:24.743738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:24.756664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1136/2271] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:24.760496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:24.773383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86a31-21f8-4ebb-8baf-595e073b04c4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:24.778396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:24.779015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.779301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.779581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.788826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:24.788826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:24.788826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:24.794926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1136/2272] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:24.799382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:24.812701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0bd7-3824-433d-bc10-7ad6f05b5460 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:24.817674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:24.819777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:24.820095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:24.820368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:24.821047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:24.823010 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:25.223278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:25.244495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1137/2273] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:24 2022] POST /identity/v3/projects => generated 375 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:25.245318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:25.267951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572d1b9-0130-46f2-9ae4-439d8f01d98e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:25.367586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:25.370201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:25.370201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:25.370201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:25.370201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:25.373061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:25.485918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1137/2274] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:25 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:25.488458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:25.525040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252537-6ce9-447a-a44f-f0b415166247 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:25.528694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:25.529451 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:25.529842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:25.530223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:25.531071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:25.532988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:25.548548 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1138/2275] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:25.549720 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:25.562181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31335ae1-bb2f-4326-9676-b14552b6d51f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:25.570617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:25.572695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:25.573376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:25.574043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:25.575128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:25.577162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29692-6aa7-45a5-91fd-613809f09d21 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:25.600056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1138/2276] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:25.601106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:25.619978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37062-b012-48ad-b177-a48fddc2fd34 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:25.626673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:25.627734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:25.628214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:25.628676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] PATH_INFO: `/v3/projects/ec3a1317ccd44f7790239a526b9e9ee7/users/c552df08b6184fd4af282f87a5b34854/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:25.650006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3a1317ccd44f7790239a526b9e9ee7, user_id=c552df08b6184fd4af282f87a5b34854, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:25.653489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:25.714513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1139/2277] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:25 2022] PUT /identity/v3/projects/ec3a1317ccd44f7790239a526b9e9ee7/users/c552df08b6184fd4af282f87a5b34854/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:25.730344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:25.730344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:25.730344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:25.814655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] MFA Rules not processed for user `c552df08b6184fd4af282f87a5b34854`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:25.816250 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:25.927653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1139/2278] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:25.932857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:26.012431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22b83-c22b-4e1b-a68b-858ed83f29a7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:26.018581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:26.019484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.019770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.020123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.022033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:26.023638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:26.144336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1140/2279] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:25 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:26.145204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:26.160806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3477c7-d6d8-43a0-957a-1a463ea1f1d4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:26.268972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:26.269836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.270224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.270763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.273824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:26.276418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:26.395340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1140/2280] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:26 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:26.400574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:26.414005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad36260-745d-4974-bd45-5bd836e326a0 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:26.420112 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:26.421028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.421481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.421923 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.422811 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:26.425571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:26.459304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1141/2281] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:26.463286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:26.478273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965e66-fb36-4f31-a6c4-5e063873a022 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:26.484959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:26.486561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.487541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.488125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.489086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:26.492093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca7647-87e4-4615-9eac-f16aab0bbd2c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:26.504725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1141/2282] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:19:26.509664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:26.522947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb6f2c-a528-4638-957c-b2b2861ce1b7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:26.530461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:26.531753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.532436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.533565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] PATH_INFO: `/v3/projects/e860575ebe324b8ca02738af0e19fcc9/users/5dadaefa2cc64bd6a9260818726d273e/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.561734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e860575ebe324b8ca02738af0e19fcc9, user_id=5dadaefa2cc64bd6a9260818726d273e, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:26.571062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:26.655660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:26.701192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1142/2283] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:26 2022] PUT /identity/v3/projects/e860575ebe324b8ca02738af0e19fcc9/users/5dadaefa2cc64bd6a9260818726d273e/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:26.703342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:26.703836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:26.703947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:26.785436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] MFA Rules not processed for user `5dadaefa2cc64bd6a9260818726d273e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:26.787482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:26.838100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:26.957333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1142/2284] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:26.963743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.109174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8b21-1967-4aae-bda7-f270da7d47f3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.116204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.122185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.122185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.122185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.122185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.124102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:27.234000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.235845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:27.295079 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1143/2285] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:26 2022] POST /identity/v3/projects => generated 375 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:27.298072 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.363657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8a9a9-52f6-491b-bd44-4efa0d9369f2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.423342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675e65-b7ef-4072-80fe-bbd5ccd0dfbe admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.433885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.434602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.434837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.435101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.435940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.438568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:27.463684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.465103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.465601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.466079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.468678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:27.550522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.553790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:27.579819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1144/2286] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:27 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:27.588893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.589079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1143/2287] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:27.613064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea760e2-4c7c-4297-8c7d-ad6eb0edc28b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.626947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.629505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.629505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.629505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.629505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.632932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:27.655772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1145/2288] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:27.661144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.687080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2175-a397-42a0-9cd5-7080f280d4ef service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.697308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.698006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.698289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.698571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] PATH_INFO: `/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7/users/4f5f6aa9ecf3402699e93cdeeaa58f4a/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.726286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9127cbdbaa4a3fa7d9f61a8a75b0f7, user_id=4f5f6aa9ecf3402699e93cdeeaa58f4a, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.729977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:27.831881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1144/2289] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:27 2022] PUT /identity/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7/users/4f5f6aa9ecf3402699e93cdeeaa58f4a/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:27.836077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:27.851960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5bd1b-4932-4eb5-a1f2-c2f4e3e56cf5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:27.977286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:27.977931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:27.978210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:27.978803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:27.979719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:27.984263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c643f-b90e-4eca-8207-9e6895e21464 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:28.007556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:28.009052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1146/2290] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:28.029272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128096e-9d7e-47ef-af92-b50c7a7cac47 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:28.037483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:28.038380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:28.038821 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:28.039270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] PATH_INFO: `/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7/users/4f5f6aa9ecf3402699e93cdeeaa58f4a/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:28.043108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9127cbdbaa4a3fa7d9f61a8a75b0f7, user_id=4f5f6aa9ecf3402699e93cdeeaa58f4a, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:28.047358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:28.079036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1145/2291] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:28 2022] PUT /identity/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7/users/4f5f6aa9ecf3402699e93cdeeaa58f4a/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:28.091312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:28.091601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:28.091870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:28.137049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] MFA Rules not processed for user `4f5f6aa9ecf3402699e93cdeeaa58f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:28.138349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:28.226654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1147/2292] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:28.238578 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:28.240556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:28.307553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26c0b4-0d49-482d-b681-d5d051274e66 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:28.312202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:28.313124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:28.315380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:28.316156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:28.341588 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:28.387523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:28.389708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:28.414550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1146/2293] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:28.886937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:29.306040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:29.307533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:29.456486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb721d-ae80-4c5c-9d9e-75e296ca92f6 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:29.462324 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:29.463190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:29.463634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:29.463948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] PATH_INFO: `/v3/users/9ffd0dad58824c87bf12016fc3c9ae7c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:29.465332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffd0dad58824c87bf12016fc3c9ae7c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:29.467553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:29.484763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:29.495219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2472-1458-4600-a6b8-34be19f94a4c service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:29.500023 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:29.500894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:29.501391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:29.501879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:29.503814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:29.578252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:29.579724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56bd4-ef03-4fb4-9947-152b36a0dce8 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:29.590274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1147/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:29.685070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffd0dad58824c87bf12016fc3c9ae7c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:29.694641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffd0dad58824c87bf12016fc3c9ae7c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:29.695397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffd0dad58824c87bf12016fc3c9ae7c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:29.718876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffd0dad58824c87bf12016fc3c9ae7c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:29.797768 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffd0dad58824c87bf12016fc3c9ae7c'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:29.810075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1148/2295] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:29 2022] DELETE /identity/v3/users/9ffd0dad58824c87bf12016fc3c9ae7c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:29.816603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437559b7-06db-4520-8334-85b34c328e5d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:29.817445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437559b7-06db-4520-8334-85b34c328e5d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:29.817815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437559b7-06db-4520-8334-85b34c328e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:29.840108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-437559b7-06db-4520-8334-85b34c328e5d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:29.841562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-437559b7-06db-4520-8334-85b34c328e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:29.922520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1148/2296] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:29.934896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:29.937882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:29.999547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:30.016340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef1f5-fc1d-43fc-a685-c0ddd1e74064 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:30.023107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:30.023890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:30.025085 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:30.025481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:30.040523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:30.042115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:30.055449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1149/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:30.426608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:30.685280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:30.757855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437559b7-06db-4520-8334-85b34c328e5d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:30.759399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-437559b7-06db-4520-8334-85b34c328e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:30.850117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437559b7-06db-4520-8334-85b34c328e5d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:30.855675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:30.856618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:30.857082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:30.857916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:30.860416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:31.009337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:31.010917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:31.021646 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1149/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:31.493499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:31.495425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:31.518564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed96a-bb3e-493a-baf5-02f190880d77 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:31.519315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:31.520047 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:31.520321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:31.521425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] PATH_INFO: `/v3/projects/d5b5658fe6954586ac8183a1f98166a9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:31.524582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b5658fe6954586ac8183a1f98166a9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:31.526834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:31.740884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b5658fe6954586ac8183a1f98166a9', 'request_id': 'req-a2e5c631-a0e7-4940-838c-93125ed4abf7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:31.765242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b5658fe6954586ac8183a1f98166a9', 'request_id': 'req-a2e5c631-a0e7-4940-838c-93125ed4abf7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:31.855528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b5658fe6954586ac8183a1f98166a9', 'request_id': 'req-a2e5c631-a0e7-4940-838c-93125ed4abf7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:31.877977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] The token cache is being invalidate because project d5b5658fe6954586ac8183a1f98166a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:31.878239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:31.883657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a2e5c631-a0e7-4940-838c-93125ed4abf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:31.886596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1150/2299] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:31 2022] DELETE /identity/v3/projects/d5b5658fe6954586ac8183a1f98166a9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:31.891037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:31.911017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9eea-813d-4004-a663-b962fc2621cd service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:32.109097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:32.109691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:32.111079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:32.112723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] PATH_INFO: `/v3/users/56fbd75701cf4aad920407fc0ff01aed` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:32.117919 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fbd75701cf4aad920407fc0ff01aed)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:32.128557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:32.373637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fbd75701cf4aad920407fc0ff01aed'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:32.382612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fbd75701cf4aad920407fc0ff01aed'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:32.383644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fbd75701cf4aad920407fc0ff01aed'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:32.384558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fbd75701cf4aad920407fc0ff01aed'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:32.399302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fbd75701cf4aad920407fc0ff01aed'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:32.461257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:32.496410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1150/2300] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:31 2022] DELETE /identity/v3/users/56fbd75701cf4aad920407fc0ff01aed => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:32.904171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:33.280958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:33.282940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:33.284294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:33.358213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] MFA Rules not processed for user `7e21017ce5a6462da558939c934801d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:33.359469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.485330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:33.493965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.531875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1151/2301] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:33.548522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:33.550158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.626680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5fe84-5853-4ceb-ae72-eead17120d6d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:33.634405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:33.635300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:33.635587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:33.636651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:33.639165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.653019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6159c3-d3b6-4301-a757-edb70dca6700 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:33.658057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:33.658771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:33.659769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:33.659769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:33.661193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.749211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:33.752069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:33.761228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:33.762754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de50178-e408-4723-94e0-d3390803480d service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:33.765111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1152/2302] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:33.766402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:33.767770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:33.785290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1151/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:33.852556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15a8da-b818-407e-a106-5bbc2ebdb9bc service glance] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:33.861020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:33.862517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:33.863333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:33.864122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] PATH_INFO: `/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:33.866615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d478fd8dd548dd9bbbd8c72509924d)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:33.869171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:34.051096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d478fd8dd548dd9bbbd8c72509924d', 'request_id': 'req-5aabcb30-657d-4bd1-a23a-065343c9d9fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:34.080111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d478fd8dd548dd9bbbd8c72509924d', 'request_id': 'req-5aabcb30-657d-4bd1-a23a-065343c9d9fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:34.125319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d478fd8dd548dd9bbbd8c72509924d', 'request_id': 'req-5aabcb30-657d-4bd1-a23a-065343c9d9fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:34.136944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] The token cache is being invalidate because project c8d478fd8dd548dd9bbbd8c72509924d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:34.137257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:34.137953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aabcb30-657d-4bd1-a23a-065343c9d9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:34.139646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1153/2304] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:33 2022] DELETE /identity/v3/projects/c8d478fd8dd548dd9bbbd8c72509924d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:34.145897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f037a-85c5-4190-ba8b-03de26957b7b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.146313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f037a-85c5-4190-ba8b-03de26957b7b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.146695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f037a-85c5-4190-ba8b-03de26957b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.173537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4f0f037a-85c5-4190-ba8b-03de26957b7b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:34.175178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4f0f037a-85c5-4190-ba8b-03de26957b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:34.229017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.229351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.229619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.273789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:34.277731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:34.280183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1152/2305] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:34.289070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.293423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.293423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.349373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:34.350984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:34.377406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1153/2306] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:34.383270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:34.401942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b722-44b2-47dc-891a-00cc21667727 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:34.408785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:34.409576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.410040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.410406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.412286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:34.412712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:34.415564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:34.436464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1154/2307] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:34.438015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:34.450108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1154/2308] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:34.456297 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ad7d-3961-4bcd-b335-e27b34b887e8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:34.464035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:34.465130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.465622 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.466116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.467834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:34.470122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:34.518913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:34.519928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:34.624189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1155/2309] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:34 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:34.628478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:34.656120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b974-9659-4833-bd90-da0c607f5deb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:34.766733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fcd-d354-4796-83d7-0f7ea4aa9c35 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:34.793542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:34.794769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.795295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.803113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.803113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:34.803113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:34.816052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:34.816921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:34.817362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:34.818481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:34.959863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:34.962398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:34.975721 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1155/2310] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 05:19:34.984731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1156/2311] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:34 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:34.994827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:35.022638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b852e-9ee7-4961-ac7e-a77f226d911e service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:35.030163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:35.031000 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:35.031352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:35.031693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:35.032510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:35.035006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:35.052959 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:35.059618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1156/2312] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:35.065796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b034bd3-e38e-4429-884b-8347636b1425 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:35.080410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:35.080410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:35.080410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:35.080410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:35.080803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:35.080803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cc602-7131-4ad0-8c9d-20af8526a525 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:35.101880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:35.109867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1157/2313] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:35.113796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e2f09-c8db-482e-8faa-03e6cf2f7f21 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:35.121011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:35.121722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:35.122219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:35.136750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] PATH_INFO: `/v3/projects/bf469420f85d47be9aa031bb5872efbd/users/f667e30841454b23843fdfebf4c36dc1/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:35.180665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf469420f85d47be9aa031bb5872efbd, user_id=f667e30841454b23843fdfebf4c36dc1, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:35.183699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:35.288625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1157/2314] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:35 2022] PUT /identity/v3/projects/bf469420f85d47be9aa031bb5872efbd/users/f667e30841454b23843fdfebf4c36dc1/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:35.292381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:35.292960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:35.293388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:35.363242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] MFA Rules not processed for user `f667e30841454b23843fdfebf4c36dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:35.366480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:35.571409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1158/2315] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:35.851348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:36.310928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:36.313105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:36.353533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:36.435277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ea06-caa8-4b6d-8e7c-5084fad05aaa admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:36.499373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:36.500053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:36.500343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:36.500615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:36.529406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:36.536933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:36.571461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1158/2316] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:37.842865 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:37.844623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:37.924053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:37.951678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be385f65-692c-4613-b0f4-eaa529bd809a service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:37.967674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:37.968703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:37.968703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:37.968925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:37.982639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:37.993384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0874-af79-4ec6-a659-a11a40154bd2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:37.999022 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:38.000148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.000533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.005523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] PATH_INFO: `/v3/users/125892d80a1d4844aac220b76b3bc495` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.005523 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125892d80a1d4844aac220b76b3bc495)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:38.006355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:38.158167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:38.160154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a329a1-a8c4-449e-a707-8329e01790cd service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:38.172800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1159/2317] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:38.247567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125892d80a1d4844aac220b76b3bc495'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:38.261871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125892d80a1d4844aac220b76b3bc495'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:38.263697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125892d80a1d4844aac220b76b3bc495'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:38.263697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125892d80a1d4844aac220b76b3bc495'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:38.279265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125892d80a1d4844aac220b76b3bc495'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:38.419472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1159/2318] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:37 2022] DELETE /identity/v3/users/125892d80a1d4844aac220b76b3bc495 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:38.424819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.425313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.426089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.522292 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:38.524309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:38.684303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1160/2319] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:38.696548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:38.698189 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:38.886563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302b8a-8754-42e8-998a-a8db8b5a4bf8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:38.916733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:38.917382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:38.925831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:38.926308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:38.964698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:38.964698 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:38.983355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1160/2320] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:39.352556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:39.913816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:39.948379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:39.950101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:39.969931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be7971-bffe-4d13-b77c-5267e6df76fb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:39.987418 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:39.988223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:39.988576 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:39.988918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] PATH_INFO: `/v3/projects/62810edbb50e4ddd8e0dc6834ffff1ec` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:39.991937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62810edbb50e4ddd8e0dc6834ffff1ec)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:39.996419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:40.244483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62810edbb50e4ddd8e0dc6834ffff1ec', 'request_id': 'req-01611d0f-2241-4bc0-b719-ceb958663a4f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:40.266737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62810edbb50e4ddd8e0dc6834ffff1ec', 'request_id': 'req-01611d0f-2241-4bc0-b719-ceb958663a4f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:40.379558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62810edbb50e4ddd8e0dc6834ffff1ec', 'request_id': 'req-01611d0f-2241-4bc0-b719-ceb958663a4f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:40.394132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] The token cache is being invalidate because project 62810edbb50e4ddd8e0dc6834ffff1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:40.394500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:40.395251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:40.402416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1161/2321] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:39 2022] DELETE /identity/v3/projects/62810edbb50e4ddd8e0dc6834ffff1ec => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:40.403881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:40.422894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094936-039c-4e4b-a678-79ad2fdfb090 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:40.543063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:40.543837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:40.544188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:40.544494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] PATH_INFO: `/v3/users/991ca555c6944945a5a966630701f850` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:40.545853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991ca555c6944945a5a966630701f850)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:40.548035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:41.274591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991ca555c6944945a5a966630701f850'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:41.287804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991ca555c6944945a5a966630701f850'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:41.288783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991ca555c6944945a5a966630701f850'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:41.289760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991ca555c6944945a5a966630701f850'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:41.312510 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991ca555c6944945a5a966630701f850'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:41.449756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1161/2322] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:40 2022] DELETE /identity/v3/users/991ca555c6944945a5a966630701f850 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:41.687081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:41.689253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:41.710676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611d0f-2241-4bc0-b719-ceb958663a4f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:41.825075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:41.826217 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:41.826816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:41.827336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] PATH_INFO: `/v3/users/c552df08b6184fd4af282f87a5b34854` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:41.829412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c552df08b6184fd4af282f87a5b34854)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:41.831876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:42.101421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:42.122113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c552df08b6184fd4af282f87a5b34854'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.138295 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c552df08b6184fd4af282f87a5b34854'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.138411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:42.138904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:42.146407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c552df08b6184fd4af282f87a5b34854'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.203599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c552df08b6184fd4af282f87a5b34854'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.204856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32082f5-10d5-40fe-9e17-338903662aa5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:42.213426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:42.214173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:42.214530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:42.215215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] PATH_INFO: `/v3/projects/00625438ed38465c80896f0cdf7440c6` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:42.218303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] RBAC: Authorizing `identity:delete_project(project_id=00625438ed38465c80896f0cdf7440c6)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:42.221306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:42.274208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4e8cc2e9-d0aa-40c2-b841-40e15f055db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c552df08b6184fd4af282f87a5b34854'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.282949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1162/2323] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:41 2022] DELETE /identity/v3/users/c552df08b6184fd4af282f87a5b34854 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:42.288488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:42.288942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:42.289289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:42.313057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:42.314494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:42.330276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:42.368913 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00625438ed38465c80896f0cdf7440c6', 'request_id': 'req-602341da-18e8-4543-91cd-0f8f216b43de'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.375979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00625438ed38465c80896f0cdf7440c6', 'request_id': 'req-602341da-18e8-4543-91cd-0f8f216b43de'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.399829 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1163/2324] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:42.412144 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:42.415369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:42.443620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00625438ed38465c80896f0cdf7440c6', 'request_id': 'req-602341da-18e8-4543-91cd-0f8f216b43de'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.456900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] The token cache is being invalidate because project 00625438ed38465c80896f0cdf7440c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:42.457461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.459279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.461340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1162/2325] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:42 2022] DELETE /identity/v3/projects/00625438ed38465c80896f0cdf7440c6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:42.465641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:42.467018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:42.493132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1c6a-97aa-4053-8cfd-8f589bc41c9e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:42.558898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:42.559617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:42.559896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:42.560197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:42.562546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:42.564708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602341da-18e8-4543-91cd-0f8f216b43de admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:42.570854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:42.572100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:42.572600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:42.572983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] PATH_INFO: `/v3/users/7185109e42204c2897e8f03b63e03a35` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:42.574892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7185109e42204c2897e8f03b63e03a35)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:42.579081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:42.584647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:42.587029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:42.600713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1164/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:19:42.798991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7185109e42204c2897e8f03b63e03a35'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.824165 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7185109e42204c2897e8f03b63e03a35'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.825077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7185109e42204c2897e8f03b63e03a35'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.825709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7185109e42204c2897e8f03b63e03a35'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.854685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7185109e42204c2897e8f03b63e03a35'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:42.993809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1163/2327] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:42 2022] DELETE /identity/v3/users/7185109e42204c2897e8f03b63e03a35 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:43.310351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:43.475274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:43.477347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:43.495830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b709b-d2d5-4d80-8626-a902d1e0166d service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:43.626912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:43.627797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:43.628235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:43.628599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] PATH_INFO: `/v3/projects/ec3a1317ccd44f7790239a526b9e9ee7` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:43.631017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3a1317ccd44f7790239a526b9e9ee7)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:43.633225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:43.700404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:43.790179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3a1317ccd44f7790239a526b9e9ee7', 'request_id': 'req-a759e16e-7ee3-4368-892b-05edfb09f54e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:43.798624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3a1317ccd44f7790239a526b9e9ee7', 'request_id': 'req-a759e16e-7ee3-4368-892b-05edfb09f54e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:43.908850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3a1317ccd44f7790239a526b9e9ee7', 'request_id': 'req-a759e16e-7ee3-4368-892b-05edfb09f54e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:43.928373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] The token cache is being invalidate because project ec3a1317ccd44f7790239a526b9e9ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:43.928818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:43.929803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:43.932240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1165/2328] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:43 2022] DELETE /identity/v3/projects/ec3a1317ccd44f7790239a526b9e9ee7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:43.936392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:43.937905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:43.962732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232136f-0503-44af-8240-9827b99343ea admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:44.120483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:44.121634 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:44.122204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:44.123356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] PATH_INFO: `/v3/users/5dadaefa2cc64bd6a9260818726d273e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:44.125105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dadaefa2cc64bd6a9260818726d273e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:44.129306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:44.402349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dadaefa2cc64bd6a9260818726d273e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:44.422384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dadaefa2cc64bd6a9260818726d273e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:44.425979 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dadaefa2cc64bd6a9260818726d273e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:44.430106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dadaefa2cc64bd6a9260818726d273e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:44.468273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-73c70888-e590-48d1-a251-45b1d7d13d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dadaefa2cc64bd6a9260818726d273e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:44.529537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:44.531039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:44.585951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1164/2329] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:43 2022] DELETE /identity/v3/users/5dadaefa2cc64bd6a9260818726d273e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:44.590805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759e16e-7ee3-4368-892b-05edfb09f54e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:44.886813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:44.887755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:44.888584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:44.889419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] PATH_INFO: `/v3/projects/6321873c3db94319ba2c6fee5f512dab` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:44.893286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6321873c3db94319ba2c6fee5f512dab)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:44.900683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:45.619367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6321873c3db94319ba2c6fee5f512dab', 'request_id': 'req-bddb4213-0da0-4892-8d28-4becc3451542'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:45.656463 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6321873c3db94319ba2c6fee5f512dab', 'request_id': 'req-bddb4213-0da0-4892-8d28-4becc3451542'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:45.786570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6321873c3db94319ba2c6fee5f512dab', 'request_id': 'req-bddb4213-0da0-4892-8d28-4becc3451542'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:45.814817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] The token cache is being invalidate because project 6321873c3db94319ba2c6fee5f512dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:45.817986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:45.818553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bddb4213-0da0-4892-8d28-4becc3451542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:45.821559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1166/2330] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:44 2022] DELETE /identity/v3/projects/6321873c3db94319ba2c6fee5f512dab => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:45.831359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:45.832499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:45.833243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:45.861006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:45.862513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:45.986810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1165/2331] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:45.992856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:45.993520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.001067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.036515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:46.038925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:46.070074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1167/2332] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:46.072515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.089110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7528c12-90d5-4b1f-b5c7-19e2ea1ef087 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.103185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.104508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.104867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.105669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.106823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:46.106823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.108941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.132562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1166/2333] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:46.142025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.144819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b286706-da86-4000-98ee-d7268bbca2df None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.157109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.158485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.159061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.159559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.160697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.163810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.274586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1168/2334] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:46 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:19:46.288321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.294532 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc10c2b-ca7c-454b-957e-c2efc19a56a9 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.415495 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.417551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:46.440111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.441063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.441564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.442105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.444270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.450785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.462408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:46.591641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d573748-8bef-4132-b2e3-66d4dc05c865 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.602715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.603828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.604360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.604841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] PATH_INFO: `/v3/projects/e860575ebe324b8ca02738af0e19fcc9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.606409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e860575ebe324b8ca02738af0e19fcc9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.609845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.674454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1167/2335] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:46 2022] POST /identity/v3/users => generated 292 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:46.682697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.727997 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef4f70-00c2-4a28-aae7-3567127d0208 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.738618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.738618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.738618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.738618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.739707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.741140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.763295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1168/2336] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:46.764977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.766906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e860575ebe324b8ca02738af0e19fcc9', 'request_id': 'req-b3eabc9f-5680-4222-9c54-392678ea6019'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:46.777388 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e860575ebe324b8ca02738af0e19fcc9', 'request_id': 'req-b3eabc9f-5680-4222-9c54-392678ea6019'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:46.794949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7e08-3506-4abe-8614-45f50bf0d2b0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.803994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:46.855965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e860575ebe324b8ca02738af0e19fcc9', 'request_id': 'req-b3eabc9f-5680-4222-9c54-392678ea6019'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:46.876364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] The token cache is being invalidate because project e860575ebe324b8ca02738af0e19fcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:46.876654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:46.879087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:46.890504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1169/2337] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:46 2022] DELETE /identity/v3/projects/e860575ebe324b8ca02738af0e19fcc9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:46.893964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.908632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:46.925472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:46.926279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:46.926653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:46.926972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:46.927706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:46.929422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:46.962456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1169/2338] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:46.968964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:46.971392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:46.990233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb585-21d7-4a51-906e-8664241c6853 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:46.999623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:47.001027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.002239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.003319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] PATH_INFO: `/v3/projects/47ff3137652544348f214dc0fe9f2e2e/users/178b1e40b39d4899b0b0e00b84f4b655/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.026518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eabc9f-5680-4222-9c54-392678ea6019 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:47.028102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ff3137652544348f214dc0fe9f2e2e, user_id=178b1e40b39d4899b0b0e00b84f4b655, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:47.032995 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:47.034240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.034884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.035394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] PATH_INFO: `/v3/users/4f5f6aa9ecf3402699e93cdeeaa58f4a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.038182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5f6aa9ecf3402699e93cdeeaa58f4a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:47.040850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:47.045041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c852f74-b4df-4e30-88ff-3d56ce08d422 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:47.167640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1170/2339] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:46 2022] PUT /identity/v3/projects/47ff3137652544348f214dc0fe9f2e2e/users/178b1e40b39d4899b0b0e00b84f4b655/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:47.186114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.186403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.186815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.210990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:47.212263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.337595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1171/2340] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:47.351087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:47.351087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.394286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5f6aa9ecf3402699e93cdeeaa58f4a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:47.417367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5f6aa9ecf3402699e93cdeeaa58f4a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:47.421255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5f6aa9ecf3402699e93cdeeaa58f4a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:47.452752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5f6aa9ecf3402699e93cdeeaa58f4a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:47.481269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dceef0-af87-42b9-9aa0-e6482ee45565 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:47.499276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:47.500097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:47.500452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:47.500804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:47.503092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:47.522223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:47.524171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe0be-c0a5-4e8a-86a0-bbaa82171b21 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:47.529529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5f6aa9ecf3402699e93cdeeaa58f4a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:47.541215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1170/2341] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:46 2022] DELETE /identity/v3/users/4f5f6aa9ecf3402699e93cdeeaa58f4a => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:47.587696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1172/2342] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:48.384607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:48.387436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:48.540177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183887-c379-4e6b-a9d2-4121bfc0ab25 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:48.553135 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:48.554022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:48.555089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:48.555488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] PATH_INFO: `/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:48.557166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9127cbdbaa4a3fa7d9f61a8a75b0f7)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:48.560305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:48.683030 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:48.757611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9127cbdbaa4a3fa7d9f61a8a75b0f7', 'request_id': 'req-7e53ae46-04bb-40b8-b420-62d17d25f241'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:48.787553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9127cbdbaa4a3fa7d9f61a8a75b0f7', 'request_id': 'req-7e53ae46-04bb-40b8-b420-62d17d25f241'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:48.912433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9127cbdbaa4a3fa7d9f61a8a75b0f7', 'request_id': 'req-7e53ae46-04bb-40b8-b420-62d17d25f241'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:48.940967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] The token cache is being invalidate because project da9127cbdbaa4a3fa7d9f61a8a75b0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:19:48.941259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:48.942637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7e53ae46-04bb-40b8-b420-62d17d25f241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:48.947706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1171/2343] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:19:48 2022] DELETE /identity/v3/projects/da9127cbdbaa4a3fa7d9f61a8a75b0f7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:48.949481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:48.964668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:48.965677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:48.966366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.023385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:49.026740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:49.183296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1173/2344] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:49.193459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.193873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.194248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.229930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:49.233540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:49.262229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1172/2345] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:49.263806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.275795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658675-6c42-4621-9e6e-f5fd83f1b96a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.295021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.295675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.295996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.296263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.296978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:19:49.297283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.298924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:49.327015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1174/2346] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:19:49.330303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.341364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001c76-082f-41a6-96f3-727073c2ed8f None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.352502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.353143 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.353480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.353764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.354444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.356445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:49.517942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1173/2347] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:49 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:49.524744 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.534855 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc5eb9-4629-4c0f-bba8-b9f66b527871 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.622797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.623441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.623726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.624102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.624788 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.626709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:49.730672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1175/2348] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:19:49 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:19:49.735253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.752226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293e220-092b-492b-96bc-efdb37212620 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.762413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.764586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.764586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.764877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.765896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.767792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:49.780815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1174/2349] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:49.784649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.797347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c17a5-fe0a-4d77-94d8-3d2f74294214 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.804176 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.805258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.805725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.806210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.807166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.809016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3a276-7440-4342-bccd-86d34f1cb46a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:49.829005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:49.831511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1176/2350] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:19:49.840767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c26b-04cc-43c7-a032-2cc5a0d8bcc1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:49.850903 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:49.852180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:49.852180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:49.852180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] PATH_INFO: `/v3/projects/c1a56f95e11b4e01b0c57c0ce5e5c5b3/users/6d632b97ae6f457ca3efac6631fba451/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:49.873393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a56f95e11b4e01b0c57c0ce5e5c5b3, user_id=6d632b97ae6f457ca3efac6631fba451, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:49.876665 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:50.006557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1175/2351] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:19:49 2022] PUT /identity/v3/projects/c1a56f95e11b4e01b0c57c0ce5e5c5b3/users/6d632b97ae6f457ca3efac6631fba451/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:19:50.011883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0d6a-5f17-4cb0-8552-af145d80acc9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:50.012458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0d6a-5f17-4cb0-8552-af145d80acc9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:50.012747 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0d6a-5f17-4cb0-8552-af145d80acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:50.035366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-564d0d6a-5f17-4cb0-8552-af145d80acc9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:50.037662 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-564d0d6a-5f17-4cb0-8552-af145d80acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.157088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1177/2352] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:50.219033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:50.221327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.398015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a897a3-9e8a-4d78-aa6d-43a958ff71d4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:50.406298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:50.410797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:50.410797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:50.410797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:50.430334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:50.432698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:50.445453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1176/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:50.622016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:50.815496 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69775d0-b7d5-4f6a-9724-d409fda78f59 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:50.816235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69775d0-b7d5-4f6a-9724-d409fda78f59 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:50.816235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69775d0-b7d5-4f6a-9724-d409fda78f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:50.858137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c69775d0-b7d5-4f6a-9724-d409fda78f59 None None] MFA Rules not processed for user `178b1e40b39d4899b0b0e00b84f4b655`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:50.859410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c69775d0-b7d5-4f6a-9724-d409fda78f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:50.945395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1178/2354] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:51.239767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:51.241312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:51.313169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a322f-bf6e-4133-bd3f-9697a18d6f53 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:51.316729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:51.317868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:51.318174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:51.318502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:51.329107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:51.330532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dded-9879-4c09-9537-736f8496cb53 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:51.341431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1177/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:19:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:19:51.403832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:52.678920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:52.679470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:52.679610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:52.702190 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] MFA Rules not processed for user `defd6fe1fb9d4caabff6064e53be5e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:52.703705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:52.801215 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1179/2356] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:53.048739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:53.180899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:54.539609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae227-d38b-4c74-ab70-48847ce5b1db None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:54.540269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae227-d38b-4c74-ab70-48847ce5b1db None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:54.540269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae227-d38b-4c74-ab70-48847ce5b1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:54.560021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-604ae227-d38b-4c74-ab70-48847ce5b1db None None] MFA Rules not processed for user `178b1e40b39d4899b0b0e00b84f4b655`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:54.561307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-604ae227-d38b-4c74-ab70-48847ce5b1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:54.569805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1178/2357] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:55.471701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:56.038221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:58.637983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=3,keystone:SELECT=89,keystone:INSERT=8 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:59.003951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:59.032685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:59.034504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:59.068896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc210e-7506-43b3-900d-0f01e87180c4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:59.088313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:59.088998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:59.089283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:59.089566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] PATH_INFO: `/v3/users/f667e30841454b23843fdfebf4c36dc1` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:59.095846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f667e30841454b23843fdfebf4c36dc1)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:59.095846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:19:59.371785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab405-d7cf-417a-b769-ea4a18e6eb68 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:59.372359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab405-d7cf-417a-b769-ea4a18e6eb68 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:59.373573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdab405-d7cf-417a-b769-ea4a18e6eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:59.403197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2bdab405-d7cf-417a-b769-ea4a18e6eb68 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:59.404985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2bdab405-d7cf-417a-b769-ea4a18e6eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:59.490623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f667e30841454b23843fdfebf4c36dc1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:59.516939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f667e30841454b23843fdfebf4c36dc1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:59.525042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f667e30841454b23843fdfebf4c36dc1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:59.526179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f667e30841454b23843fdfebf4c36dc1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:59.564884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f667e30841454b23843fdfebf4c36dc1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:19:59.578100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1179/2358] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:19:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:59.580383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd80ad-9f27-4a42-ae99-2cb8ef95354b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:59.580856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd80ad-9f27-4a42-ae99-2cb8ef95354b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:59.581071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd80ad-9f27-4a42-ae99-2cb8ef95354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:59.643800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a6dd80ad-9f27-4a42-ae99-2cb8ef95354b None None] MFA Rules not processed for user `6d632b97ae6f457ca3efac6631fba451`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:59.649833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a6dd80ad-9f27-4a42-ae99-2cb8ef95354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:59.749052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1180/2359] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:19:59 2022] DELETE /identity/v3/users/f667e30841454b23843fdfebf4c36dc1 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:19:59.763453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:19:59.767079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:59.830774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1180/2360] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:19:59.835018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:59.836633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:59.840739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:59.875470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:19:59.878344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:19:59.881348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597aab4-4b62-4785-8279-9e7807402455 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:19:59.892092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:19:59.893283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:19:59.893589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:19:59.893941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:19:59.979114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:19:59.983081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:00.005140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1181/2361] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:20:00.005140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:00.005140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:00.029123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1181/2362] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:00.044872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:00.047473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:00.134442 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b548-2259-48ea-ba68-99ac36a11080 service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:00.140238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:00.141207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:00.141366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:00.141538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:00.142233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:00.144629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:00.152871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321c3bb-7913-4379-814c-4ec8c0fd84d2 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:00.159980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:00.161857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:00.162372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:00.162870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:00.180462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:00.182020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:00.195532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1182/2363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:20:00.311497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1182/2364] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:19:59 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:00.316532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:00.359732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbc1cc-fa77-47e5-a24b-12b3f6e26c9c service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:00.555408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:00.556093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:00.557310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:00.560353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:00.561168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:00.563384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:00.674322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1183/2365] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:20:00 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:00.679462 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:00.696351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ee70-18a7-418f-b47e-7d6f9fffc8f9 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:00.710109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:00.710922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:00.711209 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:00.711511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:00.726851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:00.743263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:00.772326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1183/2366] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:20:00.775042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:00.793714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855bf6d-2e08-43d0-82f6-666df3b4dc04 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:00.817747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:00.817747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:00.817747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:00.817747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] PATH_INFO: `/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1/users/1fa4847d5b32477bbaaa86ef8e8e4642/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:00.903433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6d8d5426c64aa485f65193e9a9abb1, user_id=1fa4847d5b32477bbaaa86ef8e8e4642, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:00.906124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:00.913639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:01.024700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1184/2367] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:20:00 2022] PUT /identity/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1/users/1fa4847d5b32477bbaaa86ef8e8e4642/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:01.029381 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:01.065847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b255-b7a4-4b0f-b6fb-a1bd602669d5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:01.172616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:01.175137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:01.248465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:01.253507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:01.253507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:01.253507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:01.253848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:01.255579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:01.267460 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:01.295013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1184/2368] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:20:01.299291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:01.327473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac9a9d-fdc8-4555-8954-c0cafee79cbb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:01.349881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:01.355794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:01.358256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:01.358815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] PATH_INFO: `/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1/users/1fa4847d5b32477bbaaa86ef8e8e4642/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:01.371893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6d8d5426c64aa485f65193e9a9abb1, user_id=1fa4847d5b32477bbaaa86ef8e8e4642, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:01.377543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360cd8-08ea-4b15-a8c0-e00f4395028a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:01.418285 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1185/2369] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:20:01 2022] PUT /identity/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1/users/1fa4847d5b32477bbaaa86ef8e8e4642/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:01.454165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790e8db-4b6a-455d-8e2f-97069da5ced3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:01.572663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:01.605069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:01.608561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:01.608873 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:01.610171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] PATH_INFO: `/v3/projects/bf469420f85d47be9aa031bb5872efbd` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:01.613224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf469420f85d47be9aa031bb5872efbd)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:01.619149 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:01.873547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf469420f85d47be9aa031bb5872efbd', 'request_id': 'req-4000ac5b-dc4e-4cea-9e85-6895f1c81144'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:01.887076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf469420f85d47be9aa031bb5872efbd', 'request_id': 'req-4000ac5b-dc4e-4cea-9e85-6895f1c81144'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:01.976179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf469420f85d47be9aa031bb5872efbd', 'request_id': 'req-4000ac5b-dc4e-4cea-9e85-6895f1c81144'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:01.996819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] The token cache is being invalidate because project bf469420f85d47be9aa031bb5872efbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:20:01.997165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:01.997867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-4000ac5b-dc4e-4cea-9e85-6895f1c81144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:02.006672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:02.007946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:02.008249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:02.013233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1185/2370] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:20:01 2022] DELETE /identity/v3/projects/bf469420f85d47be9aa031bb5872efbd => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:02.072044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:02.074061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:02.300190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:02.323239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1186/2371] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:02.332197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:02.332546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:02.332819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:02.366745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:02.368124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:02.385369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1186/2372] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:02.389958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:02.410005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689696c-3e1a-466c-a9e9-590c4b263065 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:02.432797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:02.433516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:02.434028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:02.434509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:02.435621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:20:02.436047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:02.441296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:02.459955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1187/2373] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:20:02.463867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:02.476275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c908-e62d-48a1-80b2-4a535442d1d0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:02.501714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:02.502485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:02.503038 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:02.503372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:02.505002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:02.526198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:02.677653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1187/2374] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:20:02 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:02.679052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:02.714059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc664-2e52-429a-8334-0bdb946683db admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:02.917951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:02.921939 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:02.923103 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:02.923391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:02.926639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:02.933474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:03.092032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1188/2375] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:20:02 2022] POST /identity/v3/users => generated 284 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:03.096794 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:03.122160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33d14-49d9-4581-8e79-feb5dcca2505 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:03.141013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:03.150818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:03.151436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:03.151878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:03.153959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:03.158680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:03.184895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1188/2376] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:20:03.189024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:03.202840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967bdf-8183-4833-a329-39826a00aa1a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:03.211882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:03.213941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:03.217238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:03.217778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:03.218753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:03.220652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97738cc-6c4e-4090-ae91-15f80214a80e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:03.270781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1189/2377] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:20:03.272640 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:03.300895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be610f-2d59-46b0-bb8f-6e81c0dd4b79 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:03.306961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:03.308134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:03.308134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:03.308353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] PATH_INFO: `/v3/projects/53deaf07ceb345c59fbe1662daef4ea0/users/2dcc5e179fbc4440b87ddea25ec3a994/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:03.325568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53deaf07ceb345c59fbe1662daef4ea0, user_id=2dcc5e179fbc4440b87ddea25ec3a994, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:03.342678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:03.461877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1189/2378] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:20:03 2022] PUT /identity/v3/projects/53deaf07ceb345c59fbe1662daef4ea0/users/2dcc5e179fbc4440b87ddea25ec3a994/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:03.477255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f44d-cb27-473a-b500-6fe18a638836 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:03.477542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f44d-cb27-473a-b500-6fe18a638836 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:03.477988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369f44d-cb27-473a-b500-6fe18a638836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:03.580770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7369f44d-cb27-473a-b500-6fe18a638836 None None] MFA Rules not processed for user `2dcc5e179fbc4440b87ddea25ec3a994`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:03.596263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7369f44d-cb27-473a-b500-6fe18a638836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:03.659822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:03.782130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1190/2379] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:03.797698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:03.801949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:04.109863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d5a6-6277-4eaf-8a0e-33d487c34746 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:04.122818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:04.124044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:04.129511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:04.129511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:04.152400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:04.154711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59d5e3-e0a5-4fbc-96b0-850a24a3133a service glance] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:04.179681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1190/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:04.480337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:05.003425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:05.820161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:06.712812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:08.477423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:09.340614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:09.357166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:09.357166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:09.357714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:09.411765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] MFA Rules not processed for user `071141217ce84c2aac232628ff5d0de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:09.417951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:09.554346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1191/2381] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:12.804771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:13.151596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:14.008713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:14.271998 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:15.012606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332be7-72d4-4394-b255-487486a92d09 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:15.013124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332be7-72d4-4394-b255-487486a92d09 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:15.013431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332be7-72d4-4394-b255-487486a92d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:15.046937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-76332be7-72d4-4394-b255-487486a92d09 None None] MFA Rules not processed for user `1fa4847d5b32477bbaaa86ef8e8e4642`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:15.048384 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-76332be7-72d4-4394-b255-487486a92d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:15.180836 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1191/2382] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:15.186246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:15.336615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:15.338594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:15.429525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:15.433916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfe43c-66f1-43eb-bf14-0567b38b7604 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:15.447279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:15.449008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:15.449404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:15.449930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:15.452501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:15.533605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:15.536010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24ef6-71d0-43f5-8426-4cecafacc5d1 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:15.547430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1192/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:15.979641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:15.980254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:15.980711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:15.983307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1192/2384] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:20:16.021604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:16.022203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:16.022638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:16.058055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] MFA Rules not processed for user `b6b3afafa65b40f6a20461377a7f57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:16.065191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:16.075175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:16.239256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1193/2385] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:16.280141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:16.284705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:16.334727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63541f8-7e40-47cc-9697-f9cfc12c5962 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:16.345448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:16.346662 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:16.346787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:16.347230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:16.348323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:16.388024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:16.390947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:16.407791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1193/2386] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:16.528535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:17.342490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:17.344294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:17.448329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1189ac-bff9-448b-9560-b12588cd1ed1 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:17.457339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:17.458581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:17.458881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:17.459153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] PATH_INFO: `/v3/users/2b39f851aceb4b53af0330a4e65955b8` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:17.460702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b39f851aceb4b53af0330a4e65955b8)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:17.462812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:17.661467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b39f851aceb4b53af0330a4e65955b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:17.669515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b39f851aceb4b53af0330a4e65955b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:17.670503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b39f851aceb4b53af0330a4e65955b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:17.671139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b39f851aceb4b53af0330a4e65955b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:17.689967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b39f851aceb4b53af0330a4e65955b8'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:17.745203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:17.842280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1194/2387] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:20:17 2022] DELETE /identity/v3/users/2b39f851aceb4b53af0330a4e65955b8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:17.965818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:18.284698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:18.297478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133da7b-13d3-4078-84a5-da98e006ff68 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:18.407552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:18.408410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:18.408669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:18.416199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] PATH_INFO: `/v3/projects/3bfcdbc6c49943cdbe20de4e829055fa` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:18.416199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfcdbc6c49943cdbe20de4e829055fa)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:18.416199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:18.641750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfcdbc6c49943cdbe20de4e829055fa', 'request_id': 'req-b403fa79-8ee3-426f-91b0-4d91b24111ce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:18.652661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfcdbc6c49943cdbe20de4e829055fa', 'request_id': 'req-b403fa79-8ee3-426f-91b0-4d91b24111ce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:18.717162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:18.750677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfcdbc6c49943cdbe20de4e829055fa', 'request_id': 'req-b403fa79-8ee3-426f-91b0-4d91b24111ce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:18.768942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] The token cache is being invalidate because project 3bfcdbc6c49943cdbe20de4e829055fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:20:18.773839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:18.780842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b403fa79-8ee3-426f-91b0-4d91b24111ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:18.794305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:18.795480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1194/2388] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:20:18 2022] DELETE /identity/v3/projects/3bfcdbc6c49943cdbe20de4e829055fa => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:18.797016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:18.823135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a2046-80f2-4245-bfcd-7423cb1af8db admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:18.963933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:18.964915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:18.965213 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:18.965493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] PATH_INFO: `/v3/users/8a06e37b9da34e69b6a1a5f6fa5ee98f` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:18.968776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a06e37b9da34e69b6a1a5f6fa5ee98f)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:18.974069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:19.320669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a06e37b9da34e69b6a1a5f6fa5ee98f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:19.349288 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a06e37b9da34e69b6a1a5f6fa5ee98f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:19.358509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a06e37b9da34e69b6a1a5f6fa5ee98f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:19.360478 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a06e37b9da34e69b6a1a5f6fa5ee98f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:19.416837 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a06e37b9da34e69b6a1a5f6fa5ee98f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:19.546674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1195/2389] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:20:18 2022] DELETE /identity/v3/users/8a06e37b9da34e69b6a1a5f6fa5ee98f => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:19.991601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:20.255438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c92da-e60d-4c81-925b-437ed3a77d0a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:20.255982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c92da-e60d-4c81-925b-437ed3a77d0a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:20.256097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c92da-e60d-4c81-925b-437ed3a77d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:20.277185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-582c92da-e60d-4c81-925b-437ed3a77d0a None None] MFA Rules not processed for user `6d632b97ae6f457ca3efac6631fba451`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:20.278725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-582c92da-e60d-4c81-925b-437ed3a77d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:20.354798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1195/2390] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:20.534028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:20.536699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:20.538635 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:20.635950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:20.646881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e645-c517-42d3-b26d-ca1babf8ec09 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:20.652559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:20.653221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:20.653491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:20.653775 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] PATH_INFO: `/v3/projects/5df3b08df9444b4fa47f31f981c645e5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:20.654971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df3b08df9444b4fa47f31f981c645e5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:20.656971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:20.799615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df3b08df9444b4fa47f31f981c645e5', 'request_id': 'req-656dc8a5-2913-40bb-8807-5dc24402b22e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:20.807224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df3b08df9444b4fa47f31f981c645e5', 'request_id': 'req-656dc8a5-2913-40bb-8807-5dc24402b22e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:20.904751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df3b08df9444b4fa47f31f981c645e5', 'request_id': 'req-656dc8a5-2913-40bb-8807-5dc24402b22e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:20.921555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] The token cache is being invalidate because project 5df3b08df9444b4fa47f31f981c645e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:20:20.921838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:20.922708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-656dc8a5-2913-40bb-8807-5dc24402b22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:20.925755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1196/2391] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:20:20 2022] DELETE /identity/v3/projects/5df3b08df9444b4fa47f31f981c645e5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:20:20.931447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:20.931730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:20.932346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:20.978040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:20.979428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:21.054091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1196/2392] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:21.064301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.064866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.064981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.091579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:21.092985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:21.103375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1197/2393] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:21.107478 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.118531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c908-4298-4ac3-bb27-92058a604163 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.126865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.126865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.126865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.126865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.127352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:20:21.127352 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.128166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.141185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1197/2394] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:20:21.147122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.158065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b97539-d59a-4517-bc09-1e04cc109eae None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.164638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.166963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.166963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.166963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.166963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.168785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.310423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1198/2395] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:20:21 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:20:21.317921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.329614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac84b2-52a5-450a-891d-3be52a8cefac admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.401044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.401742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.402022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.402294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.402975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.404948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.516844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1198/2396] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:20:21 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:21.521993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.533235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f0a3-5463-4a1f-adcc-a0fe2785c4ff admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.552409 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.553251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.553535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.553813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.554771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.556927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.568637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1199/2397] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:20:21.572484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.583088 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d344a-6364-49ea-b472-625185d51a77 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.588828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.589454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.589732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.590005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.590700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.592355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5118-bef2-4fc1-a070-56c973df0771 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.605353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1199/2398] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:20:21.609848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.621298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f58b80-1884-4866-bc65-fd1687970c9b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.628350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.629352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.629596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.630071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] PATH_INFO: `/v3/projects/ec36233a078a48ce867114b886042e12/users/c16fd92246c1469683f1231662223e92/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.657245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec36233a078a48ce867114b886042e12, user_id=c16fd92246c1469683f1231662223e92, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.662224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.779894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1200/2399] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:20:21 2022] PUT /identity/v3/projects/ec36233a078a48ce867114b886042e12/users/c16fd92246c1469683f1231662223e92/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:21.790677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d238a-be3a-4738-bd64-8dffe0da8d41 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.790966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d238a-be3a-4738-bd64-8dffe0da8d41 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.791245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d238a-be3a-4738-bd64-8dffe0da8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.811820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-368d238a-be3a-4738-bd64-8dffe0da8d41 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:21.812974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-368d238a-be3a-4738-bd64-8dffe0da8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:21.877883 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1200/2400] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:21.888440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:21.890224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:21.954493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8283a6-4c54-4496-914b-986f449ee120 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:21.959465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:21.960101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:21.960386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:21.960689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:21.970819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:21.973000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:21.984268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1201/2401] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:22.053670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:22.277870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:23.499389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:24.053549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417c6f-c907-4a57-b3cc-1490a883fe96 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:24.054455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417c6f-c907-4a57-b3cc-1490a883fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:24.054892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417c6f-c907-4a57-b3cc-1490a883fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:24.120057 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-54417c6f-c907-4a57-b3cc-1490a883fe96 None None] MFA Rules not processed for user `c16fd92246c1469683f1231662223e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:24.122191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-54417c6f-c907-4a57-b3cc-1490a883fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:24.243674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1201/2402] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:24.257978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:24.259804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:24.287702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:24.353563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0719d-2922-4ea6-90f5-ebf158fa76c1 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:24.367806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:24.368630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:24.368918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:24.370042 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:24.389467 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:24.390946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:24.401812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1202/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:24.493650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:24.888953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:25.550381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:25.865132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:27.104968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:27.429700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:27.429996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:27.430271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:27.450749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] MFA Rules not processed for user `c16fd92246c1469683f1231662223e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:27.452025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:27.460419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1202/2404] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:27.814794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:28.974641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:29.163129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:30.496106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:30.551346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:30.928431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:30.962681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.024325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.116036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.144736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.356354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.441669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.470459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.698240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:31.808398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:32.064364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:32.178817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:32.631032 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:32.888049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:33.414693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:33.416269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:33.428585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb655e8-547f-4d4d-95c5-c84e9904fd4c service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:33.432224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:33.434147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:33.434147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:33.434147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:33.435169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:33.508376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:33.509829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852fef-5526-4500-84f7-5f4576b88e15 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:33.520401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1203/2405] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:33.670407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:42.087050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=55 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:44.674293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:44.676654 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:44.690200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57d29-4198-45b4-b69b-19ec8d67fc82 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:44.696545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:44.697204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:44.697486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:44.697759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] PATH_INFO: `/v3/users/2dcc5e179fbc4440b87ddea25ec3a994` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:44.698956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcc5e179fbc4440b87ddea25ec3a994)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:44.701074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:44.757265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=84 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:44.889345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcc5e179fbc4440b87ddea25ec3a994'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:44.898100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcc5e179fbc4440b87ddea25ec3a994'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:44.898845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcc5e179fbc4440b87ddea25ec3a994'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:44.912267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcc5e179fbc4440b87ddea25ec3a994'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:44.994412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcc5e179fbc4440b87ddea25ec3a994'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.001199 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1203/2406] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:20:44 2022] DELETE /identity/v3/users/2dcc5e179fbc4440b87ddea25ec3a994 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:45.006615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:45.006993 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:45.007335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:45.028875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:45.030114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:45.089179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1204/2407] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:45.100870 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:45.102267 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:45.162027 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4208-704f-4925-ba25-e8b581b9b1b8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:45.165700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:45.166315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:45.166606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:45.166876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:45.179558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:45.182414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06f14-5e20-405e-91fe-0e1fdc1116f3 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:45.194937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1204/2408] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:45.746069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:45.747595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:45.760795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8872-2280-4e9e-9515-94e242d9b8ca None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:45.767806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:45.767806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:45.767806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:45.767806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] PATH_INFO: `/v3/projects/53deaf07ceb345c59fbe1662daef4ea0` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:45.769964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53deaf07ceb345c59fbe1662daef4ea0)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:45.770384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:45.876795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53deaf07ceb345c59fbe1662daef4ea0', 'request_id': 'req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.884605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53deaf07ceb345c59fbe1662daef4ea0', 'request_id': 'req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.927473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53deaf07ceb345c59fbe1662daef4ea0', 'request_id': 'req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.939062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] The token cache is being invalidate because project 53deaf07ceb345c59fbe1662daef4ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:20:45.939377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.940068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-64eee65a-d1fe-4e0d-847a-b0d24b8980e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:45.942354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1205/2409] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:20:45 2022] DELETE /identity/v3/projects/53deaf07ceb345c59fbe1662daef4ea0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:20:45.947867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:45.948510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:45.948767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:45.970265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:45.972075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:46.030596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1205/2410] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:46.040113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.040423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.040704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.061638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:46.062826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:46.071043 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1206/2411] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:46.075408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.085417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa80c7-9d68-456a-9e4f-2eef0b9e694c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.090056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.090648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.090929 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.091208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.091943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:20:46.092257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.093872 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.108250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1206/2412] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:20:46.113470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.123031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238b8a9-8917-49c5-a180-b7c224b1e49a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.127772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.128605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.128885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.129162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.129836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.131742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.226648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1207/2413] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:20:46 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:20:46.230774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.236090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:46.242103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715d825-0e13-402c-a4e8-e6d0d129d5a4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.297566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.298180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.298460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.298735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.299397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.302040 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.367865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1207/2414] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:20:46 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:20:46.372323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.383054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2fb5-b6e5-4e78-9c5f-10c41906b9fa admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.387783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.388435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.388734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.388987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.389681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.391274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.405102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1208/2415] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:20:46.410814 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.422664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9c250-bfb8-4fd9-a23e-02d77b946687 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.427598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.428244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.428526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.428797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.429487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.431083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0048-994b-4a32-a9af-8a180667353f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.443110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1208/2416] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:20:46.447437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.458151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9d9f-5f1c-4540-8cb7-31bc16aa9ea0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.462911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.463558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.463842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.464156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] PATH_INFO: `/v3/projects/a3cc5720f98849998d1111086f71f8bd/users/697d5d5efc1f4960a3ed11d7cb1ef6a0/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.485091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cc5720f98849998d1111086f71f8bd, user_id=697d5d5efc1f4960a3ed11d7cb1ef6a0, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.490555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.585268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1209/2417] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:20:46 2022] PUT /identity/v3/projects/a3cc5720f98849998d1111086f71f8bd/users/697d5d5efc1f4960a3ed11d7cb1ef6a0/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:46.595752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.596136 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.597003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.628179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] MFA Rules not processed for user `697d5d5efc1f4960a3ed11d7cb1ef6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:46.633370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:46.708315 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1209/2418] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:20:46.716754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:46.718733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:46.746317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:46.787764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57e7fa-2ec1-4863-a182-ba6392d73685 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:46.791778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:46.792594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:46.792857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:46.793169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:46.804278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:46.809933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86413-1a47-4648-96b3-cee65ccaf6c9 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:46.820310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1210/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:20:52.710751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:52.777583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba068a1-c7a6-4e8a-ba85-976a6f92b2e6 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:52.782012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:52.782648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:52.782926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:52.783198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] PATH_INFO: `/v3/users/697d5d5efc1f4960a3ed11d7cb1ef6a0` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:52.784983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697d5d5efc1f4960a3ed11d7cb1ef6a0)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:52.786901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:52.799508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:52.950965 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697d5d5efc1f4960a3ed11d7cb1ef6a0'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:52.957810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697d5d5efc1f4960a3ed11d7cb1ef6a0'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:52.958731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697d5d5efc1f4960a3ed11d7cb1ef6a0'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:52.971017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697d5d5efc1f4960a3ed11d7cb1ef6a0'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.040006 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697d5d5efc1f4960a3ed11d7cb1ef6a0'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.046303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1210/2420] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:20:52 2022] DELETE /identity/v3/users/697d5d5efc1f4960a3ed11d7cb1ef6a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:53.053728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:53.053728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:53.053728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:53.071533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:20:53.072795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:53.133102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1211/2421] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:20:53.143700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:53.145250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:53.204455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121e0a1-a369-4f77-b199-6c980dc578b5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:53.208892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:53.209508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:53.209787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:53.210062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:53.219168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:53.220630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:53.230713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1211/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:20:53.683615 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:53.685144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:53.716195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca48e4c-688c-4dbe-88d7-0caeb3c81188 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:53.722603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:53.723268 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:53.723555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:53.723830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] PATH_INFO: `/v3/projects/a3cc5720f98849998d1111086f71f8bd` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:53.725263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cc5720f98849998d1111086f71f8bd)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:53.727638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:53.864557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cc5720f98849998d1111086f71f8bd', 'request_id': 'req-c6ff40a7-c8ef-4526-b305-550f514375e1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.871162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cc5720f98849998d1111086f71f8bd', 'request_id': 'req-c6ff40a7-c8ef-4526-b305-550f514375e1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.959995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cc5720f98849998d1111086f71f8bd', 'request_id': 'req-c6ff40a7-c8ef-4526-b305-550f514375e1'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.976411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] The token cache is being invalidate because project a3cc5720f98849998d1111086f71f8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:20:53.976759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.977503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-c6ff40a7-c8ef-4526-b305-550f514375e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:20:53.979114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1212/2423] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:20:53 2022] DELETE /identity/v3/projects/a3cc5720f98849998d1111086f71f8bd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:20:58.631752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:20:58.633188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:58.703725 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614f96-693c-437b-ae5c-9418217ed302 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:20:58.736990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:58.764505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:20:58.765170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:20:58.765501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:20:58.765777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:20:58.768071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:20:58.780909 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:20:58.782508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13d11-4455-4a18-879c-da159e349a61 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:20:58.793757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1212/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:20:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:03.974326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:07.129143 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:07.129896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:07.129896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:07.151461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] MFA Rules not processed for user `c16fd92246c1469683f1231662223e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:07.152759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:07.212661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1213/2425] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:21:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:08.666837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47046f24-5605-482d-a2ab-c28f0e9744e7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:08.667462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47046f24-5605-482d-a2ab-c28f0e9744e7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:08.667592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47046f24-5605-482d-a2ab-c28f0e9744e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:08.687751 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-47046f24-5605-482d-a2ab-c28f0e9744e7 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:08.688980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-47046f24-5605-482d-a2ab-c28f0e9744e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:08.755554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1213/2426] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:08.781638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:08.783095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:08.869799 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaabdb6-e2e3-4d2c-95e8-8d2441ef0f39 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:08.876421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:08.877050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:08.877331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:08.877604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:08.888286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:08.889947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:08.907561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1214/2427] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:13.992366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:13.992893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:13.992893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:14.012254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:14.013450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:14.021863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1214/2428] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:14.055008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:14.056690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:14.072185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaaef8-0a49-46f5-9331-aaa635b759c5 service nova] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:14.078012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:14.078750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:14.079027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:14.079306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:14.091502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:14.091502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1e019-0efd-4ab6-a9a6-8e3652bc461b service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:14.102491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1215/2429] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:16.573329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:16.574769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:16.640234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f813-d19b-408e-8f13-0615e2b519fc None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:16.648689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:16.649334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:16.649615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:16.649896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:16.652828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:16.733480 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:16.734960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:16.751009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1215/2430] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:21:19.057752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485ced-dcfd-4ab0-b31d-54ccaeea78e5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:19.058237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485ced-dcfd-4ab0-b31d-54ccaeea78e5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:19.058359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1485ced-dcfd-4ab0-b31d-54ccaeea78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:19.099657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c1485ced-dcfd-4ab0-b31d-54ccaeea78e5 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:19.101280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c1485ced-dcfd-4ab0-b31d-54ccaeea78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:19.180018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1216/2431] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:21:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:19.268078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:19.268078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:19.280466 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:19.370224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ddc6-7d1e-48e4-9d85-947477524357 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:19.375968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:19.376804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:19.377189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:19.377694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:19.389221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:19.391844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:19.405553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1216/2432] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:21:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:19.751192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f34-e74d-4035-9fa6-0e4ed5cd5fcc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:19.751940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f34-e74d-4035-9fa6-0e4ed5cd5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:19.752986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005f34-e74d-4035-9fa6-0e4ed5cd5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:19.829142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d5005f34-e74d-4035-9fa6-0e4ed5cd5fcc None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:19.832102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d5005f34-e74d-4035-9fa6-0e4ed5cd5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:19.849379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1217/2433] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:19.875062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:19.899561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfab40-5287-4af8-acab-89a7789ea9e8 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:19.905429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:19.906061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:19.906516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:19.906795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:19.920083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:19.921441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:19.947223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1217/2434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:25.807433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423a14-3f0d-4ad3-8501-e0da31f122c4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:25.807996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423a14-3f0d-4ad3-8501-e0da31f122c4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:25.807996 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423a14-3f0d-4ad3-8501-e0da31f122c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:25.878977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ff423a14-3f0d-4ad3-8501-e0da31f122c4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:25.885341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ff423a14-3f0d-4ad3-8501-e0da31f122c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:25.936704 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1218/2435] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:25.987443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:25.987443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d47d4-2bc3-499e-8ebf-03ffe4a6e22d service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:25.987443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:25.987443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:25.988502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:25.988502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:25.995333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:25.996986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:26.007068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1218/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:32.420669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493a369-4583-465d-9e8e-99a52c10ccb8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:32.421643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493a369-4583-465d-9e8e-99a52c10ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:32.421643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493a369-4583-465d-9e8e-99a52c10ccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:32.443543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7493a369-4583-465d-9e8e-99a52c10ccb8 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:32.444886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7493a369-4583-465d-9e8e-99a52c10ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:32.453077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1219/2437] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:21:32.491510 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:32.503062 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2c24c-6e1d-402c-b91c-b70268b3576c service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:32.509519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:32.510131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:32.510431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:32.510691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:32.519164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:32.520864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:32.531866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1219/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:38.719863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0892f4-1ca6-4f57-b768-ecf78cf86865 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:38.724899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0892f4-1ca6-4f57-b768-ecf78cf86865 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:38.724899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0892f4-1ca6-4f57-b768-ecf78cf86865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:38.729131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=100 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:38.741389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-eb0892f4-1ca6-4f57-b768-ecf78cf86865 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:38.742580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-eb0892f4-1ca6-4f57-b768-ecf78cf86865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:38.751070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1220/2439] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:38.785215 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:38.798456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78a2a5-5e9e-4e16-a840-5aad1bb15e99 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:38.805093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:38.805715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:38.806175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:38.806447 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:38.815946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:38.818192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db8f96-f4b9-4f94-9368-713a9ccd63d0 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:38.828410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1220/2440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:44.000691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.001276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.001276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.002610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1221/2441] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:21:44.008698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc655c1-de2a-4d6e-8800-979134356faf None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.009190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc655c1-de2a-4d6e-8800-979134356faf None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.009700 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc655c1-de2a-4d6e-8800-979134356faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.031487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4cc655c1-de2a-4d6e-8800-979134356faf None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:44.032744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4cc655c1-de2a-4d6e-8800-979134356faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:44.043487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1221/2442] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:21:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:44.055715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:44.057446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:44.117717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede2915-975b-471a-84c4-e617f4b6e099 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:44.122953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:44.123639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.123987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.124280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.139479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:44.140956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473758d6-08bc-476f-a446-9f840a10228e service glance] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:44.153697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1222/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:44.378484 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef67a-229f-4701-bcb2-94d343c7e669 None None] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.378980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef67a-229f-4701-bcb2-94d343c7e669 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.378980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef67a-229f-4701-bcb2-94d343c7e669 None None] PATH_INFO: `/` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.381053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1222/2444] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:21:44.386322 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c5b-0919-41ae-a26e-b1616aade49e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.386727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c5b-0919-41ae-a26e-b1616aade49e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.387104 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5646c5b-0919-41ae-a26e-b1616aade49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.409014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c5646c5b-0919-41ae-a26e-b1616aade49e None None] MFA Rules not processed for user `5915b2a090de42009ef03bf1d5a32f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:44.410343 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c5646c5b-0919-41ae-a26e-b1616aade49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:44.418270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1223/2445] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:21:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:44.430483 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ef67a-229f-4701-bcb2-94d343c7e669 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:44.441900 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ef67a-229f-4701-bcb2-94d343c7e669 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:44.446008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:44.446620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.446893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.447160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.454994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:44.456464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34e877-3d52-4948-9dae-e091fff072ec service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:44.465226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1223/2446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:44.553831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.554204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.554483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] PATH_INFO: `/` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.555920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1224/2447] 10.222.0.36 () {54 vars in 921 bytes} [Thu Aug 4 05:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 05:21:44.562303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1896-e7a3-434c-8986-a04aea91aa45 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.562677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1896-e7a3-434c-8986-a04aea91aa45 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.563059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc1896-e7a3-434c-8986-a04aea91aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.583252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a6cc1896-e7a3-434c-8986-a04aea91aa45 None None] MFA Rules not processed for user `55b281089b494473a7b58228ac75c898`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:44.584912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a6cc1896-e7a3-434c-8986-a04aea91aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:44.595024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1224/2448] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Aug 4 05:21:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:44.606710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:44.608964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:44.622892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08cf2b-9b6e-4a92-8e76-98a1b4595a10 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:44.626649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:44.627301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:44.627583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:44.627857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:44.642572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:44.642572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:44.652020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1225/2449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:21:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:21:45.066289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6a62-0984-4947-a206-44f0f705112d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:45.066792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6a62-0984-4947-a206-44f0f705112d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:45.066886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd6a62-0984-4947-a206-44f0f705112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:45.089089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-13dd6a62-0984-4947-a206-44f0f705112d None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:45.090565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-13dd6a62-0984-4947-a206-44f0f705112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:45.102186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1225/2450] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:21:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:45.115569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:45.135825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f676-53c6-4fe8-90bb-9b938960ed4b service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:45.142819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:45.143656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:45.143977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:45.144260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:45.163709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:45.163709 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:45.172878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1226/2451] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:55.082685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=67 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:55.168399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=43 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:58.069804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f98b-6f86-415e-a531-ad0c89c0eed7 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:58.070337 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f98b-6f86-415e-a531-ad0c89c0eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:58.070596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3f98b-6f86-415e-a531-ad0c89c0eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:58.095765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-fbd3f98b-6f86-415e-a531-ad0c89c0eed7 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:21:58.097340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fbd3f98b-6f86-415e-a531-ad0c89c0eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:21:58.110596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1226/2452] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:21:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:21:58.124974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:21:58.137051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232118-6343-49e9-b8bf-73676876cf8a service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:21:58.149432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:21:58.150217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:21:58.150507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:21:58.150790 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:21:58.165610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:21:58.168235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:21:58.183948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1227/2453] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:21:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:22:05.209083 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218db9b2-09e1-4dae-9d39-99c05e59589c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:05.209796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218db9b2-09e1-4dae-9d39-99c05e59589c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:05.209796 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218db9b2-09e1-4dae-9d39-99c05e59589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:05.245173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-218db9b2-09e1-4dae-9d39-99c05e59589c None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:05.246429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-218db9b2-09e1-4dae-9d39-99c05e59589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:05.254585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1227/2454] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:22:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:05.273058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:05.285016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ea291-7fd9-457b-93db-fab76723feab service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:05.292556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:05.300212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:05.300212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:05.300212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:05.306014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:05.307956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:05.317899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1228/2455] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:22:06.645732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:06.652752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:06.652752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:06.690290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] MFA Rules not processed for user `178b1e40b39d4899b0b0e00b84f4b655`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:06.692296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:06.788082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1228/2456] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:09.906886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:09.908431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:09.923217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1da-d090-4891-8199-7c3f2994e1e9 service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:09.928577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:09.929203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:09.929480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:09.929750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] PATH_INFO: `/v3/users/c16fd92246c1469683f1231662223e92` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:09.930900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16fd92246c1469683f1231662223e92)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:09.932829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:10.104428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16fd92246c1469683f1231662223e92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.111178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16fd92246c1469683f1231662223e92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.111840 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16fd92246c1469683f1231662223e92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.112485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16fd92246c1469683f1231662223e92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.124968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3fd550d0-33dd-48e8-b762-07ba6d376f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16fd92246c1469683f1231662223e92'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.192920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1229/2457] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:22:09 2022] DELETE /identity/v3/users/c16fd92246c1469683f1231662223e92 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:10.490404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:10.502081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4287-121d-4f77-948e-c436ff7e376b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:10.568318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:10.568946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:10.569224 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:10.569499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] PATH_INFO: `/v3/projects/ec36233a078a48ce867114b886042e12` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:10.570726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec36233a078a48ce867114b886042e12)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:10.572866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:10.674672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec36233a078a48ce867114b886042e12', 'request_id': 'req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.682563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec36233a078a48ce867114b886042e12', 'request_id': 'req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.758167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec36233a078a48ce867114b886042e12', 'request_id': 'req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.769664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] The token cache is being invalidate because project ec36233a078a48ce867114b886042e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:22:10.770012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.771063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-aa74fdd8-b9cf-49d1-919c-1608e5edfb72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:10.772703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1229/2458] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:22:10 2022] DELETE /identity/v3/projects/ec36233a078a48ce867114b886042e12 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:10.777637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:10.777922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:10.778199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:10.799298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:10.800551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:10.861535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1230/2459] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:10.871089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:10.871377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:10.871660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:10.891452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:10.892707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:10.901126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1230/2460] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:10.905350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:10.916053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce1f08-ad83-489c-83de-48d8c639d5ee None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:10.920653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:10.921257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:10.921534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:10.921804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:10.922494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:22:10.922798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:10.924427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:10.937105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1231/2461] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:22:10.941933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:10.951392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d83d-3773-4bc0-8c78-8038bd96ce50 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:10.956003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:10.956612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:10.956888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:10.957159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:10.957815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:10.959744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:10.976066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:11.995585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1231/2462] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:22:10 2022] POST /identity/v3/projects => generated 385 bytes in 1054 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:22:12.007550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:12.017904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46174aa-7c21-4495-aa44-13be243e02d6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:12.050075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:12.078609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:12.079222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.079500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.079771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.080472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:12.082588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:12.176653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1232/2463] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:22:12 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:22:12.185765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:12.196675 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eddde-4a07-4bd6-b52a-bb95ffc1a482 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:12.201632 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:12.206182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.206182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.206182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.206182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:12.206182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:12.215681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1232/2464] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:22:12.219857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:12.230670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8ad2a-ff28-4a82-9b24-7202e5d5d7ec admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:12.235454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:12.236110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.236393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.236670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.237401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:12.239667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a686-eafc-4b84-857b-767565ae8327 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:12.250312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1233/2465] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:22:12.255045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:12.265286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e0e4-0bb7-4b6d-8d6c-0cb754b313e3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:12.271119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:12.271781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.272095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.272414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] PATH_INFO: `/v3/projects/91cbc89dc37c4a2f93d65149dbfe6965/users/3b98f49e584e43b9b43c1c818724465f/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.287323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cbc89dc37c4a2f93d65149dbfe6965, user_id=3b98f49e584e43b9b43c1c818724465f, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:12.292264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:12.375671 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1233/2466] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:22:12 2022] PUT /identity/v3/projects/91cbc89dc37c4a2f93d65149dbfe6965/users/3b98f49e584e43b9b43c1c818724465f/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:12.386975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25622-eef1-49dd-8274-53820d6789df None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.387266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25622-eef1-49dd-8274-53820d6789df None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.387548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25622-eef1-49dd-8274-53820d6789df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.417080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-19f25622-eef1-49dd-8274-53820d6789df None None] MFA Rules not processed for user `3b98f49e584e43b9b43c1c818724465f`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:12.418439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-19f25622-eef1-49dd-8274-53820d6789df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:12.486072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1234/2467] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:12.498106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:12.499933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:12.559655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d5d6d-08a1-4dc3-ad45-b9ee728b3b9c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:12.563520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:12.564165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:12.564452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:12.564730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:12.574082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:12.575717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f00d4-1a4c-42c1-a335-7cb7dd9900a9 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:12.585421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1234/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:15.646853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f25622-eef1-49dd-8274-53820d6789df None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:15.722404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f25622-eef1-49dd-8274-53820d6789df None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:15.728524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:15.729180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:15.729485 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:15.729737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] PATH_INFO: `/v3/users/3b98f49e584e43b9b43c1c818724465f` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:15.730966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b98f49e584e43b9b43c1c818724465f)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:15.732943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:15.867556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:15.870309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b98f49e584e43b9b43c1c818724465f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:15.877283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b98f49e584e43b9b43c1c818724465f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:15.877952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b98f49e584e43b9b43c1c818724465f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:15.878559 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b98f49e584e43b9b43c1c818724465f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:15.891982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b98f49e584e43b9b43c1c818724465f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:15.968631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1235/2469] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:22:15 2022] DELETE /identity/v3/users/3b98f49e584e43b9b43c1c818724465f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:15.973848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:15.974323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:15.974433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:15.993841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:15.995100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:16.054953 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1235/2470] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:16.064512 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:16.065902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:16.123943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedef46-6204-449e-a804-94cc40a8bec5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:16.127489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:16.128131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:16.128420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:16.128721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:16.138471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:16.139826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920ed0-750f-42ad-8ca7-755724a6d004 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:16.151832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1236/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:16.949312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:16.950780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:16.966600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc437b-7036-4f4f-9fcc-296f03cefa7a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:16.971564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:16.972276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:16.972746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:16.973020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] PATH_INFO: `/v3/projects/91cbc89dc37c4a2f93d65149dbfe6965` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:16.975058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cbc89dc37c4a2f93d65149dbfe6965)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:16.977242 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.085669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cbc89dc37c4a2f93d65149dbfe6965', 'request_id': 'req-9de9e689-148f-4a1e-ba05-a75649bfa704'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:17.091688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cbc89dc37c4a2f93d65149dbfe6965', 'request_id': 'req-9de9e689-148f-4a1e-ba05-a75649bfa704'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:17.094250 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:17.158054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cbc89dc37c4a2f93d65149dbfe6965', 'request_id': 'req-9de9e689-148f-4a1e-ba05-a75649bfa704'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:17.169066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] The token cache is being invalidate because project 91cbc89dc37c4a2f93d65149dbfe6965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:22:17.170740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:17.170740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9de9e689-148f-4a1e-ba05-a75649bfa704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:17.171499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1236/2472] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:22:16 2022] DELETE /identity/v3/projects/91cbc89dc37c4a2f93d65149dbfe6965 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:17.177570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.178051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.178164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.198164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:17.199380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:17.259178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1237/2473] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:17.267017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.267332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.267624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.287304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:17.288537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:17.296499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1237/2474] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:17.301315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.311118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389e20-0dd0-478d-ab24-fd8c4e5d2d72 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.315723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.317027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.317303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.317574 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.318267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:22:17.318573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.320185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.331610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1238/2475] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:22:17.336367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.345678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5270-5253-42a3-9383-3a11ec982396 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.350489 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.351097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.351382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.351659 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.352379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.354313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.491890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1238/2476] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:22:17 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:22:17.496202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.506438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688662b-55de-425c-b8e5-727352eba3d7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.555842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:17.565616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.566267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.566569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.566912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.567610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.569573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.682533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1239/2477] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:22:17 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:22:17.683997 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.695325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde26b-3a0b-4c8b-ac50-a3b3c0f21f87 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.701263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.701975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.702358 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.702703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.703767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.705713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.719433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1239/2478] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:22:17.724195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.735084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb738f-8c40-4a00-ac02-e9101236974d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.740870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.741526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.741814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.742092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.742800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.744461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d08912-4996-4760-9620-1aeae8fd33be admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.757218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1240/2479] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:22:17.760983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:17.773412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2041c-f3a2-432c-b804-7f954c2d4897 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:17.780848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:17.781531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.781809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.782460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] PATH_INFO: `/v3/projects/e22455f37f804a3f8989844b59609b75/users/90466054f3a545c8b7555ba8f58d621c/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.803025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22455f37f804a3f8989844b59609b75, user_id=90466054f3a545c8b7555ba8f58d621c, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:17.805886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:17.879364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1240/2480] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:22:17 2022] PUT /identity/v3/projects/e22455f37f804a3f8989844b59609b75/users/90466054f3a545c8b7555ba8f58d621c/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:22:17.960199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba2c27-2a70-4279-8b0e-b1a2db50538a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:17.960398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba2c27-2a70-4279-8b0e-b1a2db50538a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:17.960553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba2c27-2a70-4279-8b0e-b1a2db50538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:17.990834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-43ba2c27-2a70-4279-8b0e-b1a2db50538a None None] MFA Rules not processed for user `90466054f3a545c8b7555ba8f58d621c`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:17.992237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-43ba2c27-2a70-4279-8b0e-b1a2db50538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:18.100169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1241/2481] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:18.111807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:18.114244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:18.197539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7968c8-152a-4b50-8c1a-83340df9aa91 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:18.201274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:18.201896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:18.202176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:18.202450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:18.212245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:18.213600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:18.224202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1241/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:18.782221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b0e5-f3d6-4a84-b367-50c9d0910d83 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:18.782860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b0e5-f3d6-4a84-b367-50c9d0910d83 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:18.782860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b0e5-f3d6-4a84-b367-50c9d0910d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:18.805590 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c974b0e5-f3d6-4a84-b367-50c9d0910d83 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:18.807079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c974b0e5-f3d6-4a84-b367-50c9d0910d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:18.896073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1242/2483] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:18.919264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:18.921239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:19.110591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a49c9-f311-46c3-b746-d16e13f56da5 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:19.118349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:19.125469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:19.125469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:19.125469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:19.132972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:19.135155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:19.167185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1242/2484] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:22:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:22:28.884160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:29.162438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=3,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:32.729655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b7aa-aa02-4ef1-92db-14f03799744d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:32.730251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b7aa-aa02-4ef1-92db-14f03799744d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:32.730251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b7aa-aa02-4ef1-92db-14f03799744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:32.750674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-bd71b7aa-aa02-4ef1-92db-14f03799744d None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:32.751886 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bd71b7aa-aa02-4ef1-92db-14f03799744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:32.811653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1243/2485] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:32.835492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:32.837114 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:32.911852 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb01114-79e3-494d-bbef-9f43bf6a0ba8 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:32.917533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:32.918147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:32.918429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:32.918701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:32.927981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:32.929572 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:32.939422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1243/2486] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:37.275102 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc025-ce63-4546-84a4-df139f33c8a5 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:37.275842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc025-ce63-4546-84a4-df139f33c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:37.275842 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc025-ce63-4546-84a4-df139f33c8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:37.297579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-20ccc025-ce63-4546-84a4-df139f33c8a5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:37.298796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-20ccc025-ce63-4546-84a4-df139f33c8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:37.306932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1244/2487] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:37.331206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:37.332701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:37.349204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2859091-7f6e-46eb-90ec-bfb5f18dab33 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:37.355063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:37.355690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:37.356133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:37.356420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:37.366011 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:37.367608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:37.377459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1244/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:41.153563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:41.154175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:41.154175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:41.174287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:41.175487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:41.183337 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1245/2489] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:41.213390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:41.225545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b991-f849-49a3-ab42-9ea4f37c8bbd service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:41.231461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:41.232118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:41.232400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:41.232676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:41.242538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:41.244220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:41.254696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1245/2490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:22:43.844642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:43.846039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:43.904786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ce18-c582-40dd-94d1-01db17c0f1bf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:43.908971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:43.909643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:43.909923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:43.910198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:43.912006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:43.926556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:43.928200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf28c-922b-407d-9835-b5b0ce193175 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:43.939554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1246/2491] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:47.484151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:47.485789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:47.498672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:47.499207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:47.499207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:47.499537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd143-ce80-4d94-bdf0-889c9fb44d4e service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:47.504133 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:47.504813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:47.505023 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:47.505303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:47.507331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:47.523399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:47.524410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:47.524772 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:47.526231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a304d-3a09-4001-9f5e-6ee25e4ec99e service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:47.534633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1247/2492] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:22:47.539055 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1246/2493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:47.560562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:47.575551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c65cc7-616f-42bc-9800-54545ac65bad None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:47.582497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:47.583625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:47.584296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:47.584764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:47.601252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:47.602848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263409-2c0e-48cb-af7f-62631990356d service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:47.613169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1248/2494] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:47.693155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:47.693318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:47.694300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:47.722545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] MFA Rules not processed for user `071141217ce84c2aac232628ff5d0de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:47.724074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:47.780939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1247/2495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:53.969477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:53.970685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:53.970685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:53.990730 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:53.991921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:54.000760 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1249/2496] 10.222.0.58 () {58 vars in 1016 bytes} [Thu Aug 4 05:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:22:54.032726 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:54.075319 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be97e8-5c15-4b0f-a096-97c6712dae0c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:54.083234 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:54.084129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:54.084580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:54.085012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:54.109606 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:54.112084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcae47-433e-41a1-a379-b705b29dc4c2 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:54.123116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1248/2497] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:58.261418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:58.272346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151ac81-c8d0-4c6f-8d29-ec8ba1fdc72b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:58.277113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:58.277875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:58.278160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:58.278436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] PATH_INFO: `/v3/users/90466054f3a545c8b7555ba8f58d621c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:58.279604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90466054f3a545c8b7555ba8f58d621c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:58.281748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:58.486314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90466054f3a545c8b7555ba8f58d621c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:58.493900 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90466054f3a545c8b7555ba8f58d621c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:58.494607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90466054f3a545c8b7555ba8f58d621c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:58.495261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90466054f3a545c8b7555ba8f58d621c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:58.497326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:58.509697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90466054f3a545c8b7555ba8f58d621c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:58.574324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1250/2498] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:22:58 2022] DELETE /identity/v3/users/90466054f3a545c8b7555ba8f58d621c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:22:58.578914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:58.579415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:58.579678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:58.604556 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:22:58.606002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:58.649969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:22:58.689600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1249/2499] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:22:58.701188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:58.703116 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:58.788378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f5e5-1ccb-41a1-84c5-5d2180ed41f1 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:58.792433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:58.793488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:58.793986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:58.794468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:58.811308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:58.813084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:58.825089 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1251/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:22:59.401056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:22:59.403174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:22:59.420045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b995-2e2e-4d25-ae84-972da401310e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:22:59.424809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:22:59.425502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:22:59.425952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:22:59.426233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] PATH_INFO: `/v3/projects/e22455f37f804a3f8989844b59609b75` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:22:59.427652 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22455f37f804a3f8989844b59609b75)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:22:59.429779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:22:59.564426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22455f37f804a3f8989844b59609b75', 'request_id': 'req-004350bf-d423-4f5f-a590-46b31071c9d9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:59.571808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22455f37f804a3f8989844b59609b75', 'request_id': 'req-004350bf-d423-4f5f-a590-46b31071c9d9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:59.623390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22455f37f804a3f8989844b59609b75', 'request_id': 'req-004350bf-d423-4f5f-a590-46b31071c9d9'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:59.636564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] The token cache is being invalidate because project e22455f37f804a3f8989844b59609b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:22:59.636850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:59.637526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-004350bf-d423-4f5f-a590-46b31071c9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:22:59.639059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1250/2501] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:22:59 2022] DELETE /identity/v3/projects/e22455f37f804a3f8989844b59609b75 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:23:01.355810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:01.364892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b994f2-297a-4306-9200-095ed1912fcc service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:01.418689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:01.419446 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:01.419727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:01.420137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:01.421833 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:01.488869 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:01.490318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:01.501080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1252/2502] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:04.051809 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.052511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.052511 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.072497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] MFA Rules not processed for user `089d2e686b2245dab52ff78ddfa8cb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:04.073732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:04.081058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1251/2503] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:23:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:04.408808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:04.410480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:04.421094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f54e9-3d62-4c1d-8402-d6b43356fb3a service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:04.425260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:04.426009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:04.426291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:04.426566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:04.428340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:04.438599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:04.439834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:04.449695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1253/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:05.030528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:05.032155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:05.106419 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11979f0-017c-4717-b081-470a4eb0ff15 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:05.111717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:05.112434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:05.112716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:05.113073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:05.114918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:05.126933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:05.128637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e575c7b-3488-4f07-944f-1ab6d792546d service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:05.139054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1252/2505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:10.538082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:10.539587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:10.551484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5245-2611-404a-9073-9affbf1c53f0 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:10.558410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:10.558410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:10.558410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:10.558410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:10.559733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:10.570749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:10.572346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:10.581395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1254/2506] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:11.254845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:11.255698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:11.256014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:11.276856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:11.278108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:11.324950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:11.340658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1253/2507] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:23:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:23:11.354294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:11.355817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:11.365481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:11.427961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72d60-4329-47ee-8b9b-5de9ef05df2b service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:11.433399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:11.434164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:11.434611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:11.434968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:11.444626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:11.451437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:11.454781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1255/2508] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:23:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:23:16.885002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:16.886597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:17.059482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3a28-d0cd-4c60-a231-66f0ccd4b3a2 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:17.070494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:17.074891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:17.074891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:17.074891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:17.074891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:17.092723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:17.094826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:17.113310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1254/2509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:21.736895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:21.739433 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:21.820096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a109e3-367f-49bc-acbd-191a81863ae4 service swift] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:21.824856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:21.825519 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:21.825792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:21.826064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] PATH_INFO: `/v3/users/defd6fe1fb9d4caabff6064e53be5e89` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:21.827276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=defd6fe1fb9d4caabff6064e53be5e89)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:21.829259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:22.109125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defd6fe1fb9d4caabff6064e53be5e89'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.116899 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defd6fe1fb9d4caabff6064e53be5e89'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.117632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defd6fe1fb9d4caabff6064e53be5e89'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.118246 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defd6fe1fb9d4caabff6064e53be5e89'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.131684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defd6fe1fb9d4caabff6064e53be5e89'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.219260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1256/2510] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:23:21 2022] DELETE /identity/v3/users/defd6fe1fb9d4caabff6064e53be5e89 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:23:22.611207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:22.630493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093248-e968-4671-bbb6-d296bcf2b723 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:22.717991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:22.718920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:22.719201 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:22.719535 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] PATH_INFO: `/v3/projects/6e83facca3f744c8b07447dfe9bc511c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:22.721299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83facca3f744c8b07447dfe9bc511c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:22.723996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:22.922349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83facca3f744c8b07447dfe9bc511c', 'request_id': 'req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:22.933840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83facca3f744c8b07447dfe9bc511c', 'request_id': 'req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.030864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83facca3f744c8b07447dfe9bc511c', 'request_id': 'req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.044974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] The token cache is being invalidate because project 6e83facca3f744c8b07447dfe9bc511c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:23:23.045647 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.046564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fb6a1c36-5b9d-499d-a648-0c5bbc2397a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.048160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1255/2511] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:23:22 2022] DELETE /identity/v3/projects/6e83facca3f744c8b07447dfe9bc511c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:23:23.053100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:23.054563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:23.071739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886029fe-4aa6-4f5a-b67d-be66470003dc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:23.088768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:23.138100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:23.138668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.138956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.139245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] PATH_INFO: `/v3/users/7e21017ce5a6462da558939c934801d5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.140494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e21017ce5a6462da558939c934801d5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:23.146711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:23.325733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e21017ce5a6462da558939c934801d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.334117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e21017ce5a6462da558939c934801d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.334907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e21017ce5a6462da558939c934801d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.335535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e21017ce5a6462da558939c934801d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.349186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e21017ce5a6462da558939c934801d5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:23.421400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.421690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.421972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.433025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:23.439691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1257/2512] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:23:23 2022] DELETE /identity/v3/users/7e21017ce5a6462da558939c934801d5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:23:23.446504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] MFA Rules not processed for user `330f9f0be4434f9195ac453e5550ad29`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:23:23.447748 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:23.508268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1256/2513] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:23:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:23:23.736251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:23.738733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:23.832233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fffee-a04b-4f35-826c-7e65df3590f3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:23.838087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:23.838753 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:23.839036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:23.839315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] PATH_INFO: `/v3/projects/177f7b3b868a442a9ff6d8884c060811` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:23.841133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=177f7b3b868a442a9ff6d8884c060811)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:23.843437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:23.939758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:23.941391 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:23.980101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:23.993035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177f7b3b868a442a9ff6d8884c060811', 'request_id': 'req-921d9691-3cf1-4aef-9545-8743046bcbfb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:24.000890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177f7b3b868a442a9ff6d8884c060811', 'request_id': 'req-921d9691-3cf1-4aef-9545-8743046bcbfb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:24.021637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81972b-b9d5-412e-ba8c-e289f6640b98 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:24.082575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:24.083223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:24.083516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:24.084944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:24.086878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:24.097172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:24.098649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:24.107243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1257/2514] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:23:24.108790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:24.110791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:24.111054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177f7b3b868a442a9ff6d8884c060811', 'request_id': 'req-921d9691-3cf1-4aef-9545-8743046bcbfb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:24.125273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] The token cache is being invalidate because project 177f7b3b868a442a9ff6d8884c060811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:23:24.127888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:24.130895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:24.132805 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1258/2515] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:23:23 2022] DELETE /identity/v3/projects/177f7b3b868a442a9ff6d8884c060811 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:23:24.250362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87a508-fa3e-4cf9-a021-5e811d3fb018 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:24.258287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:24.259131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:24.259413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:24.259688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:24.261971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:24.273842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:24.281304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:24.285298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:24.301906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1258/2516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:32.341063 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:32.342910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:32.411935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d9691-3cf1-4aef-9545-8743046bcbfb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:32.416736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:32.417378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:32.417657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:32.417932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] PATH_INFO: `/v3/users/178b1e40b39d4899b0b0e00b84f4b655` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:32.419117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178b1e40b39d4899b0b0e00b84f4b655)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:32.421083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:32.605157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178b1e40b39d4899b0b0e00b84f4b655'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:32.613506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178b1e40b39d4899b0b0e00b84f4b655'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:32.614742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178b1e40b39d4899b0b0e00b84f4b655'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:32.615340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178b1e40b39d4899b0b0e00b84f4b655'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:32.628021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178b1e40b39d4899b0b0e00b84f4b655'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:32.699552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1259/2517] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:23:32 2022] DELETE /identity/v3/users/178b1e40b39d4899b0b0e00b84f4b655 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:23:32.981420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:32.998728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97bd53-5497-4f24-a4c3-09e435866d43 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:33.062910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:33.063549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:33.063827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:33.064127 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] PATH_INFO: `/v3/projects/47ff3137652544348f214dc0fe9f2e2e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:33.065297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ff3137652544348f214dc0fe9f2e2e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:33.067207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:33.180013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ff3137652544348f214dc0fe9f2e2e', 'request_id': 'req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:33.189274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ff3137652544348f214dc0fe9f2e2e', 'request_id': 'req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:33.281400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ff3137652544348f214dc0fe9f2e2e', 'request_id': 'req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:33.293795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] The token cache is being invalidate because project 47ff3137652544348f214dc0fe9f2e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:23:33.297276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:33.297276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:23:33.297276 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1259/2518] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:23:32 2022] DELETE /identity/v3/projects/47ff3137652544348f214dc0fe9f2e2e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:23:34.545480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:34.547335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:34.598535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:34.628313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328291e1-07a5-45c8-a2ae-67be444e26c0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:34.705527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:34.705527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:34.705527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:34.705527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:34.707025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:34.721007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:34.722602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:34.734533 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1260/2519] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:36.349493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:36.351807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:36.411282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8ec8-0593-4fef-9e76-e4323cfe5ac7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:36.415738 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:36.416410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:36.416696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:36.416972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:36.418730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:36.458285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:36.479185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:36.480673 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:36.490164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1260/2520] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:23:44.853779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=42 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:46.590002 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=10 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:23:58.572946 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:23:58.574424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:58.635219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02b6fb-8a6e-488a-97a1-392fff345734 service nova] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:23:58.638948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:23:58.639696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:23:58.640019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:23:58.640305 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:23:58.643080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:23:58.712561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:23:58.714008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:23:58.723875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1261/2521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:02.532026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:02.533517 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:02.610924 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cc5b-5c89-4803-b4cb-14e030d1ebcd service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:02.616417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:02.617017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:02.617481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:02.617876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:02.619581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:02.631961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:02.634378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:02.648839 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1261/2522] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:02.687216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:02.689358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:02.703756 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263789c5-805f-4e92-8044-143432cd3991 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:02.709781 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:02.710731 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:02.711349 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:02.712432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] PATH_INFO: `/v3/users/071141217ce84c2aac232628ff5d0de2` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:02.713988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071141217ce84c2aac232628ff5d0de2)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:02.716239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:02.933468 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071141217ce84c2aac232628ff5d0de2'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:02.941856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071141217ce84c2aac232628ff5d0de2'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:02.942824 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071141217ce84c2aac232628ff5d0de2'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:02.943657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071141217ce84c2aac232628ff5d0de2'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:02.961477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-624e64d0-f209-4948-a7cd-98c3d7708850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071141217ce84c2aac232628ff5d0de2'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.034985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1262/2523] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:02 2022] DELETE /identity/v3/users/071141217ce84c2aac232628ff5d0de2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:03.277658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:03.292732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dfcc4-ea98-4aa8-b2c1-0e6733a7d315 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:03.358631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:03.359286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.359567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.359842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] PATH_INFO: `/v3/projects/4b5b45382d914f1a9c6dc010d0c199c6` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.361084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5b45382d914f1a9c6dc010d0c199c6)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:03.363612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:03.478667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5b45382d914f1a9c6dc010d0c199c6', 'request_id': 'req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.485160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5b45382d914f1a9c6dc010d0c199c6', 'request_id': 'req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.555014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5b45382d914f1a9c6dc010d0c199c6', 'request_id': 'req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.566955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] The token cache is being invalidate because project 4b5b45382d914f1a9c6dc010d0c199c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:03.567278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.567983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-05ec432e-dfa7-49a6-b78b-4baa7dbeeaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:03.569526 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1262/2524] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:03 2022] DELETE /identity/v3/projects/4b5b45382d914f1a9c6dc010d0c199c6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:03.574554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.574844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.575148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.594673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:03.595986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:03.614506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:03.657465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1263/2525] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:03.666245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.666534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.666808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.688327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:03.689531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:03.698137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1263/2526] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:03.704020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:03.712252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcc5fb-8a4d-48a5-9295-9bd1214f2c86 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:03.716791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:03.717393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.717672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.717945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.718639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:03.719002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:03.720947 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:03.733479 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1264/2527] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:03.738021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:03.748169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cc82-6150-429f-90bc-9c52638c1db0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:03.752937 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:03.753561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.754247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.754247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.754790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:03.756764 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:03.768844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:03.878838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1264/2528] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:03.879260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:03.890991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0b12f-a3d5-4345-9547-8ac596a14559 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:03.956565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:03.957261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:03.957525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:03.957797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:03.958461 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:03.960440 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:04.024527 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1265/2529] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:03 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:04.032828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:04.043241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661303-94ea-44b2-be3d-034490dd4be0 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:04.047936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:04.048538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:04.048819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:04.049092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:04.049837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:04.051424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:04.062346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1265/2530] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:04.066599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:04.077432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604694a-fb13-47c6-bb27-eaa1fef0283c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:04.082074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:04.083436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:04.083436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:04.083436 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:04.083927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:04.085540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da0851-9e09-47e9-b610-84da5bc64fe9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:04.096274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1266/2531] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:04.100471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:04.110735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4caca-f472-4ee6-86ed-37f25b4915cb admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:04.115781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:04.116024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:04.116310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:04.116583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] PATH_INFO: `/v3/projects/fd6789eda04e4dcf907469754bc2720b/users/510f23f44f1d43818107af0e25de0ef3/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:04.136530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6789eda04e4dcf907469754bc2720b, user_id=510f23f44f1d43818107af0e25de0ef3, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:04.140058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:04.384028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1266/2532] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:04 2022] PUT /identity/v3/projects/fd6789eda04e4dcf907469754bc2720b/users/510f23f44f1d43818107af0e25de0ef3/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:04.389171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700126-a99a-49a5-a4f4-34688a560a67 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:04.389458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700126-a99a-49a5-a4f4-34688a560a67 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:04.389735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700126-a99a-49a5-a4f4-34688a560a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:04.409010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-30700126-a99a-49a5-a4f4-34688a560a67 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:04.410240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-30700126-a99a-49a5-a4f4-34688a560a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:04.469549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1267/2533] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:04.480286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:04.481986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:04.541333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010a7ba-c03d-4f4b-9eda-65c96993620c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:04.545004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:04.545619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:04.545925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:04.546198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:04.555981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:04.557422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:04.568543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1267/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:10.717338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161f2a-61f1-4c87-a610-288c63459cde None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:10.718551 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161f2a-61f1-4c87-a610-288c63459cde None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:10.719153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161f2a-61f1-4c87-a610-288c63459cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:10.752328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-06161f2a-61f1-4c87-a610-288c63459cde None None] MFA Rules not processed for user `510f23f44f1d43818107af0e25de0ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:10.753630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-06161f2a-61f1-4c87-a610-288c63459cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:10.775983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:10.825742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1268/2535] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:10.841070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:10.842603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:10.944180 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6dc5-c9eb-424e-b42f-d355418c9f85 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:10.950771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:10.951540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:10.951827 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:10.952367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:10.961733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:10.963797 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:10.977546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1268/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:13.547060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:13.552663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:13.552663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:13.578667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] MFA Rules not processed for user `510f23f44f1d43818107af0e25de0ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:13.580133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:13.593329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1269/2537] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:16.209441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:16.211571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:16.228203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6536-4d15-4145-bfeb-dd775ca106b5 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:16.233856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:16.234494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:16.234779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:16.235086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:16.236902 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:16.282181 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:16.298304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:16.299971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:16.309440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1269/2538] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:23.563476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=22 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:26.338024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=8 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:26.999298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:27.000513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:27.014073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0604d-a2cf-4ac6-8e11-dd4f954cc1ef None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:27.018284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:27.018952 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:27.019251 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:27.019528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:27.021777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:27.035681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:27.037168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:27.048371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1270/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:31.082240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:31.083838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:31.098991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa32f5-75c8-4ee4-8a7a-a2b9cd6edc5a service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:31.104649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:31.105327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:31.105639 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:31.105913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] PATH_INFO: `/v3/users/089d2e686b2245dab52ff78ddfa8cb00` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:31.107240 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089d2e686b2245dab52ff78ddfa8cb00)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:31.109225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:31.249628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089d2e686b2245dab52ff78ddfa8cb00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.257190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089d2e686b2245dab52ff78ddfa8cb00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.257974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089d2e686b2245dab52ff78ddfa8cb00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.273564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089d2e686b2245dab52ff78ddfa8cb00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.325362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6dce9da3-2719-42d3-af4b-059a0a6daa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089d2e686b2245dab52ff78ddfa8cb00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.332731 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1270/2540] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:31 2022] DELETE /identity/v3/users/089d2e686b2245dab52ff78ddfa8cb00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:31.595800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:31.606617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c5b8e-a65c-43c7-a189-d11169d2d413 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:31.674315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:31.675118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:31.675408 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:31.675685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] PATH_INFO: `/v3/projects/771a1124e14144ee8037cb2b26452d8c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:31.676907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] RBAC: Authorizing `identity:delete_project(project_id=771a1124e14144ee8037cb2b26452d8c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:31.678923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:31.784082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771a1124e14144ee8037cb2b26452d8c', 'request_id': 'req-3ad25f76-10b6-46bb-b556-7141cca4069f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.790672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771a1124e14144ee8037cb2b26452d8c', 'request_id': 'req-3ad25f76-10b6-46bb-b556-7141cca4069f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.874187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771a1124e14144ee8037cb2b26452d8c', 'request_id': 'req-3ad25f76-10b6-46bb-b556-7141cca4069f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.886375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] The token cache is being invalidate because project 771a1124e14144ee8037cb2b26452d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:31.886672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.887329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3ad25f76-10b6-46bb-b556-7141cca4069f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:31.889166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1271/2541] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:31 2022] DELETE /identity/v3/projects/771a1124e14144ee8037cb2b26452d8c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:31.894746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:31.895034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:31.895312 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:31.916860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:31.918108 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:31.980350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1271/2542] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:31.988765 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:31.989052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:31.989331 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.009571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:32.010925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:32.019326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1272/2543] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:32.023651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.034368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902897c-5f2e-49f3-b0fb-84863bfcda7a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.039041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.039698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.040121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.040404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.041104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:32.041415 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.043032 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.054680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1272/2544] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:32.059088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.068350 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271a3ec-7e83-4684-acfe-ad4f12027baf None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.073723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.074327 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.074604 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.074875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.075534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.077489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.172080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1273/2545] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:32 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:32.173137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.185259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0854df-ec35-4b04-9943-0a7830ad30a4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.256958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.257605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.257895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.258168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.259530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.261682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.270408 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:32.366666 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1273/2546] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:32 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:32.371859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.384783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28903ebb-378d-4889-ab2f-d3c3a6925a3e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.391380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.391380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.391380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.391380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.392445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.394226 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.407026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1274/2547] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:32.411235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.422969 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632d61-4c95-4bac-9c6d-71d28be9c232 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.427789 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.428493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.428779 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.429058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.429787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.432091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d91de1-b66f-497e-b11b-b20e063e5efb admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.444221 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1274/2548] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:32.449518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.461341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f53776-1aaf-4dc5-b7b2-460c0d6b7fb4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.466783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.467950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.468170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.468293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] PATH_INFO: `/v3/projects/75460bae71a9453eb0cdbf2ce5e891cd/users/51699c63f8344fcdabfcc63fc519fb17/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.490465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75460bae71a9453eb0cdbf2ce5e891cd, user_id=51699c63f8344fcdabfcc63fc519fb17, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.494049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.555453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1275/2549] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:32 2022] PUT /identity/v3/projects/75460bae71a9453eb0cdbf2ce5e891cd/users/51699c63f8344fcdabfcc63fc519fb17/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:32.570152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.570152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.570152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.608558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] MFA Rules not processed for user `51699c63f8344fcdabfcc63fc519fb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:32.609886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:32.684688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1275/2550] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:32.689272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.709027 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:32.766425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc05363-24f5-4c30-a5aa-ef3015e57aa4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.771795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.772579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.772864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.773137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.773802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.776732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:32.882606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1276/2551] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:32 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:32.887036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:32.898570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d80e7a-1349-4b69-9c4b-9c2963ebe6d0 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:32.967446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:32.968025 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:32.968310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:32.969051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:32.969746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:32.971734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.057417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1276/2552] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:32 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:33.061850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:33.073317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604e6f7-e391-47a5-a60f-9d66cd3a06b3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:33.078108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:33.078716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.079002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.079316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.080047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:33.081637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.093313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1277/2553] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:33.098210 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:33.109919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e1c7-a2ad-4708-bc72-8c1f73cd45f4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:33.114615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:33.115280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.115555 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.115828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] PATH_INFO: `/v3/projects/df42d3b8705140b18f9cc05781aa7feb/users/a672891b684f434f844fb291ede1eaa5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.133502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df42d3b8705140b18f9cc05781aa7feb, user_id=a672891b684f434f844fb291ede1eaa5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:33.137988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.201115 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1277/2554] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:33 2022] PUT /identity/v3/projects/df42d3b8705140b18f9cc05781aa7feb/users/a672891b684f434f844fb291ede1eaa5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:33.205166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:33.216394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf74ba-52b2-41dd-a7e9-cf27724681a0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:33.280673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:33.281321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.281605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.281882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.282581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:33.284208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a09b4-2d38-46f9-9050-25443786e253 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.299231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1278/2555] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:33.300604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:33.311769 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fc6c-a1d5-4713-b584-ed2e942ddb28 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:33.316573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:33.317246 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.317531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.317818 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] PATH_INFO: `/v3/projects/df42d3b8705140b18f9cc05781aa7feb/users/a672891b684f434f844fb291ede1eaa5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.319861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df42d3b8705140b18f9cc05781aa7feb, user_id=a672891b684f434f844fb291ede1eaa5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:33.323308 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.334286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1278/2556] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:33 2022] PUT /identity/v3/projects/df42d3b8705140b18f9cc05781aa7feb/users/a672891b684f434f844fb291ede1eaa5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:33.345263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.345545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.345819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.379133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] MFA Rules not processed for user `a672891b684f434f844fb291ede1eaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:33.380400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:33.453995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1279/2557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:33.466156 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:33.468012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:33.497636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:33.538261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d492d-7a43-4834-abad-b770c7d53443 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:33.538261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:33.538261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:33.538261 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:33.538638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:33.549563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:33.551187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a8fe6-c406-4eef-9e2f-771a917194e7 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:33.565051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1279/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:34.515612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:34.529566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:34.588383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061728c7-2e8a-48d5-99bd-aebe09366453 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:34.593445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:34.594302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:34.594953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:34.595403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] PATH_INFO: `/v3/users/51699c63f8344fcdabfcc63fc519fb17` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:34.596669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51699c63f8344fcdabfcc63fc519fb17)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:34.598664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:34.794076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51699c63f8344fcdabfcc63fc519fb17'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:34.801808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51699c63f8344fcdabfcc63fc519fb17'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:34.802515 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51699c63f8344fcdabfcc63fc519fb17'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:34.803396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51699c63f8344fcdabfcc63fc519fb17'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:34.816187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51699c63f8344fcdabfcc63fc519fb17'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.051516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1280/2559] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:34 2022] DELETE /identity/v3/users/51699c63f8344fcdabfcc63fc519fb17 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:35.056869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:35.057414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:35.057414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:35.078213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:35.079458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:35.144594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1280/2560] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:35.152186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:35.153888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:35.217395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d80fc-faf2-48bd-a0a8-80fae3481e57 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:35.221411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:35.222113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:35.222399 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:35.222684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:35.233014 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:35.234536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:35.245186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1281/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:35.630196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:35.631727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:35.647798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba93f-4713-40b7-beb4-4cb78c5613e1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:35.653331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:35.654147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:35.654545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:35.655294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] PATH_INFO: `/v3/projects/75460bae71a9453eb0cdbf2ce5e891cd` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:35.656037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75460bae71a9453eb0cdbf2ce5e891cd)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:35.658179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:35.765943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75460bae71a9453eb0cdbf2ce5e891cd', 'request_id': 'req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.772365 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75460bae71a9453eb0cdbf2ce5e891cd', 'request_id': 'req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.823005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75460bae71a9453eb0cdbf2ce5e891cd', 'request_id': 'req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.834229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] The token cache is being invalidate because project 75460bae71a9453eb0cdbf2ce5e891cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:35.834520 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.835219 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:35.837118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1281/2562] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:35 2022] DELETE /identity/v3/projects/75460bae71a9453eb0cdbf2ce5e891cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:35.845038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:35.851088 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e024b-5bf8-4bba-b3de-5b4bd813763d service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:35.885902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:35.914412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:35.915806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:35.916123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:35.916404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] PATH_INFO: `/v3/users/a672891b684f434f844fb291ede1eaa5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:35.917608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a672891b684f434f844fb291ede1eaa5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:35.919605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:36.159454 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a672891b684f434f844fb291ede1eaa5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.167500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a672891b684f434f844fb291ede1eaa5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.171319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a672891b684f434f844fb291ede1eaa5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.171319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a672891b684f434f844fb291ede1eaa5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.181000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e00e23fe-6a4c-4620-8b75-42b0b440b7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a672891b684f434f844fb291ede1eaa5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.234290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1282/2563] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:35 2022] DELETE /identity/v3/users/a672891b684f434f844fb291ede1eaa5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:36.638898 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:36.640780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:36.656050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1d89f-1f82-40c9-b1b8-b4301d4a74d7 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:36.704617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:36.718046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:36.718570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:36.718848 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:36.719122 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] PATH_INFO: `/v3/projects/df42d3b8705140b18f9cc05781aa7feb` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:36.720332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df42d3b8705140b18f9cc05781aa7feb)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:36.722931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:36.821824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df42d3b8705140b18f9cc05781aa7feb', 'request_id': 'req-f02214be-924f-4134-9e8e-a1350dc5ea88'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.828926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df42d3b8705140b18f9cc05781aa7feb', 'request_id': 'req-f02214be-924f-4134-9e8e-a1350dc5ea88'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.920477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df42d3b8705140b18f9cc05781aa7feb', 'request_id': 'req-f02214be-924f-4134-9e8e-a1350dc5ea88'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.932689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] The token cache is being invalidate because project df42d3b8705140b18f9cc05781aa7feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:36.933028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.933616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-f02214be-924f-4134-9e8e-a1350dc5ea88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:36.935193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1282/2564] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:36 2022] DELETE /identity/v3/projects/df42d3b8705140b18f9cc05781aa7feb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:36.940228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:36.940707 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:36.940828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:36.961296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:36.962568 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:37.025304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1283/2565] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:37.033730 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.034020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.034304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.054868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:37.056862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:37.064810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1283/2566] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:37.069152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.078971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845909-60c2-4f7f-97e2-82ef1d01defa None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.083438 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.084069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.084347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.084616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.085370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:37.085598 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.087864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.099528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1284/2567] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:37.104892 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.114393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c293e1c-a6fa-427a-9cad-5d40b8edd25a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.119348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.119996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.120277 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.120600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.121298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.123203 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.219105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1284/2568] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:37 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:37.223650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.234806 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f62d6-a996-4074-a1bf-6ec9d10fa356 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.268853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:37.293712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.294341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.294626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.294904 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.295661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.298135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.372745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1285/2569] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:37 2022] POST /identity/v3/users => generated 280 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:37.376759 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.388287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40bfa-1b34-4e09-b4cb-0388129bcdcf admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.393348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.393993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.394270 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.394540 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.395227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.396866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.407930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1285/2570] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:37.412295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.423315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0717c8d-2010-40da-8285-9e443e2863ac admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.428825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.429497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.429777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.430093 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.431623 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.433405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1b8e1-7650-4b8e-8ad1-c5a5b339f144 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.448456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1286/2571] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:37.449680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.460087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512321fd-5f6f-4b79-879c-be753f6b5c95 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.465686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.466349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.466635 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.466899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] PATH_INFO: `/v3/projects/6be33e8519bc4ca780b917ae99c0de7c/users/c47cb70b91f54f9aaf67df042a2c7377/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.484306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be33e8519bc4ca780b917ae99c0de7c, user_id=c47cb70b91f54f9aaf67df042a2c7377, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.486919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.572440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1286/2572] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:37 2022] PUT /identity/v3/projects/6be33e8519bc4ca780b917ae99c0de7c/users/c47cb70b91f54f9aaf67df042a2c7377/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:37.584324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.584725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.585060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.614975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] MFA Rules not processed for user `c47cb70b91f54f9aaf67df042a2c7377`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:37.616233 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:37.683217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1287/2573] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:37.723226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:37.725473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:37.911550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1f97-f179-4473-8206-e049e0b64f14 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:37.915274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:37.915893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:37.916204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:37.916474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:37.924803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:37.926223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a22a4-2257-4b29-8852-2a4e3cc81cbc service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:37.934981 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1287/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:37.950667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:38.014319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e5c19-4e59-49a3-bf86-5f442d4ef79d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:38.019282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:38.020066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:38.020351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:38.020628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] PATH_INFO: `/v3/users/c47cb70b91f54f9aaf67df042a2c7377` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:38.021809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47cb70b91f54f9aaf67df042a2c7377)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:38.023722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:38.236910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47cb70b91f54f9aaf67df042a2c7377'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:38.238055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:38.244694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47cb70b91f54f9aaf67df042a2c7377'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:38.245401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47cb70b91f54f9aaf67df042a2c7377'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:38.246017 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47cb70b91f54f9aaf67df042a2c7377'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:38.257804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47cb70b91f54f9aaf67df042a2c7377'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:38.331580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1288/2575] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:37 2022] DELETE /identity/v3/users/c47cb70b91f54f9aaf67df042a2c7377 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:38.336486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a8-a07b-4205-b47b-e59e384174af None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:38.336986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a8-a07b-4205-b47b-e59e384174af None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:38.337263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a8-a07b-4205-b47b-e59e384174af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:38.356860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-4c2807a8-a07b-4205-b47b-e59e384174af None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:38.358091 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-4c2807a8-a07b-4205-b47b-e59e384174af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:38.368225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:38.419378 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1288/2576] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:38.429473 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:38.431469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:38.491927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdef3a-ca20-43ad-8306-8b85e06ff39e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:38.496681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:38.497318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:38.497596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:38.497868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:38.507295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:38.508930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:38.519859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1289/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:38.847933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:38.848476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:38.848734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:38.870620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:38.871979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:38.921847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:38.923619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:38.946817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088567d-bcd9-4dd5-a4ad-12b2467a9fb5 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:38.950992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1289/2578] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:38.952506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:38.953310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:38.953594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:38.953876 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] PATH_INFO: `/v3/projects/6be33e8519bc4ca780b917ae99c0de7c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:38.955174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be33e8519bc4ca780b917ae99c0de7c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:38.957148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.074239 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be33e8519bc4ca780b917ae99c0de7c', 'request_id': 'req-2076bbf9-3358-4fad-8830-240ca1f5a7bf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:39.080745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be33e8519bc4ca780b917ae99c0de7c', 'request_id': 'req-2076bbf9-3358-4fad-8830-240ca1f5a7bf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:39.107672 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.109123 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:39.137629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be33e8519bc4ca780b917ae99c0de7c', 'request_id': 'req-2076bbf9-3358-4fad-8830-240ca1f5a7bf'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:39.162110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] The token cache is being invalidate because project 6be33e8519bc4ca780b917ae99c0de7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:39.162769 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:39.163945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2076bbf9-3358-4fad-8830-240ca1f5a7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:39.167643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1290/2579] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:38 2022] DELETE /identity/v3/projects/6be33e8519bc4ca780b917ae99c0de7c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:39.172777 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beeb45-c785-40bf-a103-5e2f27101371 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.173127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beeb45-c785-40bf-a103-5e2f27101371 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.176216 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beeb45-c785-40bf-a103-5e2f27101371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.198711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-73beeb45-c785-40bf-a103-5e2f27101371 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:39.200036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-73beeb45-c785-40bf-a103-5e2f27101371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:39.220621 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbed792-e06c-4c76-9841-cdd868084ed8 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.251525 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:39.266047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1291/2580] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:39.275264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.275549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.275828 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.300296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:39.301834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:39.304406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.305749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.306071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.306386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.308229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:39.313737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1292/2581] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:39.316497 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:39.319072 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.328839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36dac1-e09a-4283-a26f-c36c484e3b02 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.334284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.338851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.353172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1293/2582] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:24:39.356516 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.369736 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad033fe8-31c2-4552-aa36-9defefea608c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.374956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.375726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.376046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.376826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.377020 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.378956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.383708 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.385538 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.397454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1290/2583] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 05:24:39.488613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1294/2584] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:39 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:39.494294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.511591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb693a-adc7-4c36-bc73-816c39b3e24f service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.587493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.588076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.588371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.588642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.589321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.591274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.686608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1291/2585] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:39 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:24:39.691333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.704817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f84a8-841c-44c6-ae72-e0c07f575a0a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.710366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.710813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.711118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.712005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.712746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.714352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.727953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1295/2586] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:39.730694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.741961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746b252-4cf7-4ec4-b4d7-2aa84c3baf8b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.753800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.754441 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.754711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.754986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.755698 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.757306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb30bd-217b-450b-9c6c-1e38d64fc169 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.770714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1292/2587] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:24:39.775301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:39.786236 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7c99-5271-43da-b72a-30f52930795e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:39.792140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:39.792825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.793097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.793366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] PATH_INFO: `/v3/projects/bc42c944942545b49096f3515bd47287/users/b178649c115645dba63d4a167a193e2c/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.814606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc42c944942545b49096f3515bd47287, user_id=b178649c115645dba63d4a167a193e2c, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:39.817412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:39.898242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1296/2588] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:39 2022] PUT /identity/v3/projects/bc42c944942545b49096f3515bd47287/users/b178649c115645dba63d4a167a193e2c/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:39.900134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:39.900739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:39.900739 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:39.959946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] MFA Rules not processed for user `b178649c115645dba63d4a167a193e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:39.964973 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:40.080264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1293/2589] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:40.084661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.171400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b67190-3be9-4ef0-8533-e7676ed17eb7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.176813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.177539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.177892 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.178242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.179010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.181681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.325333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1297/2590] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:40 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:40.329951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.345071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085be53-1e73-465e-9ee8-a65feb54ac40 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.357735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:40.416304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.416978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.417382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.417989 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.419187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.421282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.499824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1294/2591] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:40 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:40.503609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.515133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a0dc-5854-45d3-9907-ea9c45be347f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.522517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.523247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.524266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.524813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.525671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.527561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.540522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1298/2592] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:40.545162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.557345 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04059fd5-790a-4b72-9b9a-a6333da7dae2 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.564915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.565815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.566107 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.566383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] PATH_INFO: `/v3/projects/a3840514675a46e5833bf906bdc816f9/users/9dd1258394fa4b4f952b0133af41dd1f/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.585598 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3840514675a46e5833bf906bdc816f9, user_id=9dd1258394fa4b4f952b0133af41dd1f, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.588933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.669657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1295/2593] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:40 2022] PUT /identity/v3/projects/a3840514675a46e5833bf906bdc816f9/users/9dd1258394fa4b4f952b0133af41dd1f/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:40.673531 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.684702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc567-1ce9-4ac3-8d75-be20308fccff admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.754187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:40.769238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.772335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.773380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.774367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.775342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.777263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5b706-2459-4c31-9668-59e1cb28cfb2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.790107 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1299/2594] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:40.795788 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:40.808380 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493800-ffb4-46cd-801b-28fe3906dc4f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:40.815781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:40.816545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.816825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.817101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] PATH_INFO: `/v3/projects/a3840514675a46e5833bf906bdc816f9/users/9dd1258394fa4b4f952b0133af41dd1f/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.819200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3840514675a46e5833bf906bdc816f9, user_id=9dd1258394fa4b4f952b0133af41dd1f, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:40.822744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:40.838043 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1296/2595] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:40 2022] PUT /identity/v3/projects/a3840514675a46e5833bf906bdc816f9/users/9dd1258394fa4b4f952b0133af41dd1f/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:40.849351 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:40.849995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:40.850318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:40.887425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] MFA Rules not processed for user `9dd1258394fa4b4f952b0133af41dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:40.889690 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:41.001907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1300/2596] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:41.010736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:41.013190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:41.150503 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3372360-7cde-482d-a985-c26772b143ec admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:41.156064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:41.157191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:41.157659 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:41.158093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:41.266045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:41.266045 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6bcd2-0c43-4f31-888b-a1cbc38d9453 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:41.275711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1297/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:44.452363 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:44.558708 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974415b2-edea-4fc9-9eee-c476ace7310b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:44.569085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:44.569774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:44.570056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:44.570332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] PATH_INFO: `/v3/users/b178649c115645dba63d4a167a193e2c` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:44.572040 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b178649c115645dba63d4a167a193e2c)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:44.574005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:44.817637 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b178649c115645dba63d4a167a193e2c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:44.835962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b178649c115645dba63d4a167a193e2c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:44.837676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b178649c115645dba63d4a167a193e2c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:44.838329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b178649c115645dba63d4a167a193e2c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:44.854558 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:44.855682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b178649c115645dba63d4a167a193e2c'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:44.947059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1301/2598] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:44 2022] DELETE /identity/v3/users/b178649c115645dba63d4a167a193e2c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:44.952084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:44.952681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:44.952869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:44.987018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:44.989259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:45.008069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:45.077499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1298/2599] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:45.088396 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:45.090221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:45.173564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b7ebb-9fd4-4c18-90fc-e295eefaa537 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:45.177535 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:45.178332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:45.179311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:45.179607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:45.190739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:45.192404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:45.203401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1302/2600] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:46.134485 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:46.135124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:46.151481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f3b7e-7ab2-437c-84ef-481703c63179 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:46.157385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:46.158050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:46.158401 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:46.158592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] PATH_INFO: `/v3/projects/bc42c944942545b49096f3515bd47287` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:46.159808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc42c944942545b49096f3515bd47287)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:46.162073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:46.264307 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc42c944942545b49096f3515bd47287', 'request_id': 'req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.271723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc42c944942545b49096f3515bd47287', 'request_id': 'req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.347468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc42c944942545b49096f3515bd47287', 'request_id': 'req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.361252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] The token cache is being invalidate because project bc42c944942545b49096f3515bd47287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:46.361252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.362048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.364915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1299/2601] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:46 2022] DELETE /identity/v3/projects/bc42c944942545b49096f3515bd47287 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:46.368556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:46.379963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9565a0-a79c-4bfb-b652-941f22806cd2 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:46.453691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:46.454466 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:46.454925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:46.455172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] PATH_INFO: `/v3/users/9dd1258394fa4b4f952b0133af41dd1f` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:46.456562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd1258394fa4b4f952b0133af41dd1f)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:46.458686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:46.630664 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd1258394fa4b4f952b0133af41dd1f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.639132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd1258394fa4b4f952b0133af41dd1f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.640158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd1258394fa4b4f952b0133af41dd1f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.641276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd1258394fa4b4f952b0133af41dd1f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.659627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-8addeb77-98db-4260-af07-6cd7d4dceeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd1258394fa4b4f952b0133af41dd1f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:46.775763 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1303/2602] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:24:46 2022] DELETE /identity/v3/users/9dd1258394fa4b4f952b0133af41dd1f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:47.276913 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:47.278988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:47.303627 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9db3c-ebb3-4c11-84e3-d6de44c8a571 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:47.438467 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:47.442630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:47.442630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:47.442630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] PATH_INFO: `/v3/projects/a3840514675a46e5833bf906bdc816f9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:47.442630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3840514675a46e5833bf906bdc816f9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:47.448211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:47.603226 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:47.609233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3840514675a46e5833bf906bdc816f9', 'request_id': 'req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:47.619427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3840514675a46e5833bf906bdc816f9', 'request_id': 'req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:47.685868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3840514675a46e5833bf906bdc816f9', 'request_id': 'req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:47.706097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] The token cache is being invalidate because project a3840514675a46e5833bf906bdc816f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:24:47.706828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:47.707833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1ca14d8c-ca71-4bc1-b7fb-b408b8dafa57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:24:47.717782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1300/2603] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:24:47 2022] DELETE /identity/v3/projects/a3840514675a46e5833bf906bdc816f9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:24:47.719282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:47.719767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:47.719870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:47.754307 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:47.755883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:47.764358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:47.840154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1304/2604] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:47.841194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:47.841705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:47.842218 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:47.866251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:47.867871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:47.881008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1301/2605] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:24:47.882358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:47.893770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b64d-e171-4bb6-9853-8821655bdb75 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:47.900611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:47.901536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:47.901987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:47.902439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:47.903362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:24:47.903841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:47.905686 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:47.919937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1305/2606] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:24:47.925305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:47.937258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe30169-af12-44b2-a2a7-7a77b9841fa2 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:47.942706 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:47.943752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:47.944404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:47.944603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:47.946705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:47.948986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.053426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1302/2607] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:24:47 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:48.058117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:48.069856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f68b-5c29-4afa-9ae5-fe100ea6186e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:48.186500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:48.187133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.187422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.187694 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.188419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:48.199345 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.300943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1306/2608] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:24:48 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:24:48.305106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:48.320009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa0891-78eb-469a-a13c-c892fc596601 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:48.326498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:48.328492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.328931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.329300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.334650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:48.334650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.349041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1303/2609] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:48.350453 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:48.362879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506010-585c-4c0a-a443-008c436c5b5a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:48.372121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:48.373139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.373550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.373838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.375852 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:48.377794 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40249-902f-483d-a186-c43adaed0487 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.391951 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1307/2610] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:24:48.400350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:48.408054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425094-ffc3-476f-8b28-8f0d16f0e8a0 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:48.413370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:48.414657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.414975 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.415251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] PATH_INFO: `/v3/projects/c6e12af9f07a44789af3025d5c82d902/users/f81c7119f42e409f824d887db97d1f0b/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.436619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e12af9f07a44789af3025d5c82d902, user_id=f81c7119f42e409f824d887db97d1f0b, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:48.439327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.538037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1304/2611] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:24:48 2022] PUT /identity/v3/projects/c6e12af9f07a44789af3025d5c82d902/users/f81c7119f42e409f824d887db97d1f0b/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:24:48.549569 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e40a-942c-4445-95ab-1734272a6f1b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.549860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e40a-942c-4445-95ab-1734272a6f1b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.550141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e40a-942c-4445-95ab-1734272a6f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.592923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d7e0e40a-942c-4445-95ab-1734272a6f1b None None] MFA Rules not processed for user `f81c7119f42e409f824d887db97d1f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:24:48.594517 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d7e0e40a-942c-4445-95ab-1734272a6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:48.696295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1308/2612] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:24:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:24:48.710106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:24:48.712770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:24:48.796129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24d02-a064-4f86-b7c5-92924ca9ee77 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:24:48.800377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '208ae4c88a3440599aad61ae876837b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:24:48.801170 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:24:48.801446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:24:48.801804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:24:48.812531 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:24:48.817935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:24:48.835016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1305/2613] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:24:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:24:58.691365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:24:58.826964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:01.673614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.677518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.677518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.699441 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:01.701619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:01.777969 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1309/2614] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:01.796655 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:01.799071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:01.915580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebd3a0-3a74-4b5c-b3db-a089e823902c service glance] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:01.923949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:01.925030 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:01.925524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:01.925991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:01.941683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:01.945387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c6062-c859-4787-bca0-b82775189b6b service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:01.961583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1306/2615] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:25:11.770186 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=25 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:11.954972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=32 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:16.787817 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:16.874197 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfe7fc-7488-46e9-85fc-ea46afa2e4ec None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:16.884483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:16.885607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:16.886062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:16.886546 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] PATH_INFO: `/v3/users/f81c7119f42e409f824d887db97d1f0b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:16.888937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81c7119f42e409f824d887db97d1f0b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:16.893024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:17.229683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81c7119f42e409f824d887db97d1f0b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:17.246298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81c7119f42e409f824d887db97d1f0b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:17.247640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81c7119f42e409f824d887db97d1f0b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:17.248853 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81c7119f42e409f824d887db97d1f0b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:17.272571 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81c7119f42e409f824d887db97d1f0b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:17.361282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1310/2616] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:16 2022] DELETE /identity/v3/users/f81c7119f42e409f824d887db97d1f0b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:17.370715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:17.372081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:17.372841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:17.406179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:17.407649 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:17.513750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1307/2617] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:17.527046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:17.528487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:17.605447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789f636-df12-4f7a-8838-58bf2fda9425 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:17.609341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:17.609978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:17.610270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:17.610543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:17.621798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:17.623264 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d808f0-d46b-406e-80e5-033abf734fb4 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:17.635082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1311/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:25:18.307978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:18.309494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:18.323168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aea05e-f9f3-487b-b51c-a4de122f07c9 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:18.337227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:18.337227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.337227 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.337614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] PATH_INFO: `/v3/projects/c6e12af9f07a44789af3025d5c82d902` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.340265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e12af9f07a44789af3025d5c82d902)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:18.344132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:18.481017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e12af9f07a44789af3025d5c82d902', 'request_id': 'req-b1f03303-83df-47c6-9399-8fb6bc68c220'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:18.490168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e12af9f07a44789af3025d5c82d902', 'request_id': 'req-b1f03303-83df-47c6-9399-8fb6bc68c220'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:18.570630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e12af9f07a44789af3025d5c82d902', 'request_id': 'req-b1f03303-83df-47c6-9399-8fb6bc68c220'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:18.584351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] The token cache is being invalidate because project c6e12af9f07a44789af3025d5c82d902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:18.584628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:18.586105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-b1f03303-83df-47c6-9399-8fb6bc68c220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:18.587719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1308/2619] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:18 2022] DELETE /identity/v3/projects/c6e12af9f07a44789af3025d5c82d902 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:18.594651 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.595689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.595689 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.618211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:18.619585 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:18.644199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:18.697711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1312/2620] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:18.713392 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a316-5743-4206-804e-b57dca217c5e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.713850 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a316-5743-4206-804e-b57dca217c5e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.714314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a316-5743-4206-804e-b57dca217c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.750216 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-e762a316-5743-4206-804e-b57dca217c5e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:18.752284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e762a316-5743-4206-804e-b57dca217c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:18.763501 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1309/2621] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:18.768398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:18.780053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0021-9015-43ac-8ae5-98b08cb9e9fd None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:18.787482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:18.788751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.789067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.789926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.790529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:18.791573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:18.794588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73156-560b-4045-8f34-b67487576de5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:18.809117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1313/2622] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:25:18.813946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a316-5743-4206-804e-b57dca217c5e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:18.825920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a316-5743-4206-804e-b57dca217c5e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:18.831552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:18.832362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.832749 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.833121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.833918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:18.837165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56e060-945d-4418-a37e-cac670433bbd admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:18.909192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.909767 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.910060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:18.939221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] MFA Rules not processed for user `510f23f44f1d43818107af0e25de0ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:18.941004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:18.988773 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1310/2623] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:18.990795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:18.991842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:18.992338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.024664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:19.025918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:19.041127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1314/2624] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:19.043010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.063028 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f7a9-2ca3-4e04-9a44-943215e014e9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.109521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.120054 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1311/2625] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:19.141783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.144534 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:19.175061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.175712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.176046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.176324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.177018 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.179673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.252596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495eda3-cfef-4d81-8e6d-4e83f475bce2 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.259075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.259793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.260082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.260369 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.270163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.271838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.283082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1312/2626] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 05:25:19.326221 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1315/2627] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:19 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:19.332414 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.353493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab0e1-201c-4b72-b048-c6601983e360 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.363338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.364351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.364807 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.365248 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.366560 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.369611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.396528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1313/2628] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:19.402025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.414902 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052112-4ede-4631-b9a1-706d9449863d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.420394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.421346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.421629 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.421907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.425373 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.428273 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6aab3-2bc9-405b-8ce0-53bf77503ca3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.449211 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1316/2629] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:19.453733 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.465762 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650b15-b5e3-4ba6-b122-ab2a0cc617c1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.475285 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.477696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.478264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.478835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] PATH_INFO: `/v3/projects/13d1939518a14e06a27fee7c6dd553e9/users/417b92d523b641fe862914e388ce6a9f/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.507545 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d1939518a14e06a27fee7c6dd553e9, user_id=417b92d523b641fe862914e388ce6a9f, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.511355 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.617735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1314/2630] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:19 2022] PUT /identity/v3/projects/13d1939518a14e06a27fee7c6dd553e9/users/417b92d523b641fe862914e388ce6a9f/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:19.630543 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.631398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.631398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.666537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] MFA Rules not processed for user `417b92d523b641fe862914e388ce6a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:19.667784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:19.705118 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:19.798489 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1317/2631] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:25:19.813004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:19.816212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:19.928783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8080-24ec-4e1a-ab03-bd3e98ce875c admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:19.935190 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:19.936912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:19.936912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:19.936912 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:19.946949 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:19.948519 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76137e91-ae64-4d92-b23b-7db44d0696eb service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:19.971782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1315/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:20.027238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:20.111826 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48469f52-9f04-4548-b1da-0ef45a4fa9ec None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:20.117266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:20.118278 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:20.118435 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:20.118717 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] PATH_INFO: `/v3/users/417b92d523b641fe862914e388ce6a9f` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:20.120074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=417b92d523b641fe862914e388ce6a9f)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:20.122091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:20.426206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417b92d523b641fe862914e388ce6a9f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:20.437253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417b92d523b641fe862914e388ce6a9f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:20.438057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417b92d523b641fe862914e388ce6a9f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:20.438923 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417b92d523b641fe862914e388ce6a9f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:20.454797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417b92d523b641fe862914e388ce6a9f'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:20.595557 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1318/2633] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:20 2022] DELETE /identity/v3/users/417b92d523b641fe862914e388ce6a9f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:20.601861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:20.602680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:20.602889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:20.624832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:20.626084 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:20.681092 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:20.690630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1316/2634] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:20.705644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:20.707311 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:20.773095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:20.793056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e50b2-2413-4253-ad63-bd73a3e6f5ed admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:20.799238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:20.800304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:20.800792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:20.801267 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:20.815111 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:20.820156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bbc58-38dd-49d6-a1a9-8fbcb1a5e003 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:20.827851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1319/2635] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:21.492986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:21.497185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:21.510417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5100b-2797-4d3f-9bd3-7396a8a6a552 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:21.514729 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:21.515438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.515720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.516296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] PATH_INFO: `/v3/projects/13d1939518a14e06a27fee7c6dd553e9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.520105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d1939518a14e06a27fee7c6dd553e9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:21.520105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:21.645310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d1939518a14e06a27fee7c6dd553e9', 'request_id': 'req-90067f14-142c-46fa-9d2e-e32091f5fd09'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:21.654132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d1939518a14e06a27fee7c6dd553e9', 'request_id': 'req-90067f14-142c-46fa-9d2e-e32091f5fd09'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:21.753120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d1939518a14e06a27fee7c6dd553e9', 'request_id': 'req-90067f14-142c-46fa-9d2e-e32091f5fd09'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:21.764663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] The token cache is being invalidate because project 13d1939518a14e06a27fee7c6dd553e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:21.764954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:21.765611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-90067f14-142c-46fa-9d2e-e32091f5fd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:21.767554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1317/2636] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:21 2022] DELETE /identity/v3/projects/13d1939518a14e06a27fee7c6dd553e9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:21.773133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.773926 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.775314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.797448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:21.799247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:21.872130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1320/2637] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:21.881663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.882693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.882978 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.905172 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:21.906444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:21.918121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1318/2638] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:21.923066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:21.935052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719a13-c778-4a28-8c3b-1b0bebbc1727 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:21.940567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:21.945477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.945477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.945477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.945477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:25:21.945477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:21.946247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:21.961831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1321/2639] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:25:21.967311 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:21.985212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50182a27-1d53-498c-a52f-c9e854a470c4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:21.992551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:21.993194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:21.993482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:21.993750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:21.994436 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:21.996394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:22.202381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1319/2640] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:25:21 2022] POST /identity/v3/projects => generated 391 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:22.206943 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:22.217741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c859-1fba-4350-806d-9c247b28c33a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:22.287463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:22.288257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:22.288537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:22.288813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:22.289594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:22.291621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:22.417854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1322/2641] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:25:22 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:25:22.422609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:22.434086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e16cce-f773-449e-947d-fb0a920113c1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:22.438947 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:22.439552 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:22.439828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:22.440131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:22.440866 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:22.442491 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:22.459438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1320/2642] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:25:22.463131 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:22.477310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc32900-98d9-411d-a60b-8b2a8650d6c3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:22.483594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:22.485397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:22.485397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:22.485397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:22.486025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:22.487848 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ffc4-c0d9-4db5-9792-98308ad4175c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:22.501203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1323/2643] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:25:22.505605 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:22.516678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698878ed-f415-47e0-9b46-ac73612511f4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:22.521360 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:22.522021 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:22.525347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:22.525347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] PATH_INFO: `/v3/projects/9abcb8bdf7ad42f184827e0e18d4431b/users/62bddd6b4728483c95cba3f23d94b88e/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:22.540007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abcb8bdf7ad42f184827e0e18d4431b, user_id=62bddd6b4728483c95cba3f23d94b88e, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:22.542684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:22.610717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1321/2644] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:25:22 2022] PUT /identity/v3/projects/9abcb8bdf7ad42f184827e0e18d4431b/users/62bddd6b4728483c95cba3f23d94b88e/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:22.622132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:22.622420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:22.622912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:22.828761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] MFA Rules not processed for user `62bddd6b4728483c95cba3f23d94b88e`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:22.830019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:22.877244 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:22.911144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1324/2645] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:22.924322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:22.926332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:23.005793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e830e6-a90f-46a2-8db0-26e0b80b43a9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:23.010813 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:23.011630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:23.012044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:23.012327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:23.022325 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:23.024690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:23.035856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1322/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:26.653108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:26.655126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:26.747592 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e198b-4d64-4893-b633-e1bfd3f7ef6b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:26.751498 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:26.752198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:26.752483 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:26.752755 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:26.754748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:26.832180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:26.833723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:26.845247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1325/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:33.030915 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:34.386004 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:34.387508 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:34.449742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eece41-972f-4eb1-968d-025787e58cb8 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:34.455063 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:34.456131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:34.456638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:34.457141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:34.461860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:34.638482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:34.640206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca73fb3-69b5-4135-b422-f057347d8b65 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:34.669443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1323/2648] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:36.153341 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:36.198416 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb31c2-d2df-4cea-b1f1-b94ad3bb92ef service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:36.205544 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:36.206795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:36.207377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:36.208066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] PATH_INFO: `/v3/users/62bddd6b4728483c95cba3f23d94b88e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:36.211193 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bddd6b4728483c95cba3f23d94b88e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:36.215079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:36.522976 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bddd6b4728483c95cba3f23d94b88e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.537364 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bddd6b4728483c95cba3f23d94b88e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.539208 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bddd6b4728483c95cba3f23d94b88e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.540283 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bddd6b4728483c95cba3f23d94b88e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.563449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:36.566321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bddd6b4728483c95cba3f23d94b88e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:36.654401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1326/2649] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:36 2022] DELETE /identity/v3/users/62bddd6b4728483c95cba3f23d94b88e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:36.660776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:36.661496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:36.661755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:36.722346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:25:36.723702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:36.837031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1324/2650] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:25:36.858195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:36.860287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:36.941992 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc484-dd31-42d0-b791-a5823a12934e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:36.953098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:36.954249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:36.955035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:36.955404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:36.973684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:36.976700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:37.003047 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1327/2651] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:25:37.580964 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:37.583423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:37.628966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20054bd-a5cb-444d-b134-54fb6e8ccbe1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:37.646641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:37.648462 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:37.648970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:37.649474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] PATH_INFO: `/v3/projects/9abcb8bdf7ad42f184827e0e18d4431b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:37.655244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abcb8bdf7ad42f184827e0e18d4431b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:37.659803 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:37.674747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:37.849444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abcb8bdf7ad42f184827e0e18d4431b', 'request_id': 'req-eb7c724b-35cb-47bf-91f5-11df480a68e5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:37.881716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abcb8bdf7ad42f184827e0e18d4431b', 'request_id': 'req-eb7c724b-35cb-47bf-91f5-11df480a68e5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:38.009544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abcb8bdf7ad42f184827e0e18d4431b', 'request_id': 'req-eb7c724b-35cb-47bf-91f5-11df480a68e5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:38.031667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] The token cache is being invalidate because project 9abcb8bdf7ad42f184827e0e18d4431b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:38.032049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:38.032710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:38.034539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1325/2652] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:37 2022] DELETE /identity/v3/projects/9abcb8bdf7ad42f184827e0e18d4431b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:45.339602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:45.343304 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:45.367612 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0053-4587-4491-9911-05c7de1c8fe1 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:45.427470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:45.428660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:45.428941 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:45.429217 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] PATH_INFO: `/v3/users/6d632b97ae6f457ca3efac6631fba451` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:45.430541 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d632b97ae6f457ca3efac6631fba451)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:45.432549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:45.671657 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d632b97ae6f457ca3efac6631fba451'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:45.679680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d632b97ae6f457ca3efac6631fba451'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:45.680476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d632b97ae6f457ca3efac6631fba451'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:45.681187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d632b97ae6f457ca3efac6631fba451'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:45.694335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d632b97ae6f457ca3efac6631fba451'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:45.781773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1328/2653] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:45 2022] DELETE /identity/v3/users/6d632b97ae6f457ca3efac6631fba451 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:46.080423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:46.088821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:46.097111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c724b-35cb-47bf-91f5-11df480a68e5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:46.163701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:46.164379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:46.164661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:46.164992 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] PATH_INFO: `/v3/projects/c1a56f95e11b4e01b0c57c0ce5e5c5b3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:46.166171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a56f95e11b4e01b0c57c0ce5e5c5b3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:46.168105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:46.295720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a56f95e11b4e01b0c57c0ce5e5c5b3', 'request_id': 'req-1c8a52ef-7199-4b71-9172-46e5361cf4f1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.302349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a56f95e11b4e01b0c57c0ce5e5c5b3', 'request_id': 'req-1c8a52ef-7199-4b71-9172-46e5361cf4f1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.408948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a56f95e11b4e01b0c57c0ce5e5c5b3', 'request_id': 'req-1c8a52ef-7199-4b71-9172-46e5361cf4f1'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.421243 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] The token cache is being invalidate because project c1a56f95e11b4e01b0c57c0ce5e5c5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:46.421583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.422233 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.423840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1326/2654] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:46 2022] DELETE /identity/v3/projects/c1a56f95e11b4e01b0c57c0ce5e5c5b3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:25:46.428728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:46.430353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:46.445444 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ddc1-1473-4d3a-847b-9d4a5752ed63 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:46.454696 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:46.510890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:46.511579 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:46.511866 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:46.512173 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] PATH_INFO: `/v3/users/1fa4847d5b32477bbaaa86ef8e8e4642` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:46.513501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa4847d5b32477bbaaa86ef8e8e4642)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:46.515738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:46.733051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa4847d5b32477bbaaa86ef8e8e4642'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.741415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa4847d5b32477bbaaa86ef8e8e4642'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.742219 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa4847d5b32477bbaaa86ef8e8e4642'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.742841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa4847d5b32477bbaaa86ef8e8e4642'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.756918 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa4847d5b32477bbaaa86ef8e8e4642'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:46.851385 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1329/2655] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:25:46 2022] DELETE /identity/v3/users/1fa4847d5b32477bbaaa86ef8e8e4642 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:47.410990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:25:47.413200 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:25:47.427297 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a52ef-7199-4b71-9172-46e5361cf4f1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:25:47.455701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:47.496599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:25:47.497166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:25:47.497445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:25:47.497718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] PATH_INFO: `/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:25:47.498887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6d8d5426c64aa485f65193e9a9abb1)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:25:47.500824 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:25:47.641120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6d8d5426c64aa485f65193e9a9abb1', 'request_id': 'req-eb56e930-c6c1-4c51-885e-2b52def6ef76'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:47.647677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6d8d5426c64aa485f65193e9a9abb1', 'request_id': 'req-eb56e930-c6c1-4c51-885e-2b52def6ef76'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:47.717800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6d8d5426c64aa485f65193e9a9abb1', 'request_id': 'req-eb56e930-c6c1-4c51-885e-2b52def6ef76'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:47.730205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] The token cache is being invalidate because project ec6d8d5426c64aa485f65193e9a9abb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:25:47.730499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:47.731189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:25:47.732808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1327/2656] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:25:47 2022] DELETE /identity/v3/projects/ec6d8d5426c64aa485f65193e9a9abb1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:25:56.846361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:25:57.726677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:04.048554 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:04.050041 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.163421 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbb47-26e9-45f7-81e4-bae22934b81e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:04.225329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:04.225872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:04.226151 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:04.226425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:04.228295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:04.296434 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:04.297898 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:04.309427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1330/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:08.124333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:08.126087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:08.249906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e930-c6c1-4c51-885e-2b52def6ef76 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:08.255476 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:08.256887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:08.257168 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:08.257442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:08.259296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:08.272356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:08.273876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:08.284569 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1328/2658] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:08.297140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:08.299586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:08.315056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c033e4-48a7-424a-9bb1-dc6ef4482eba service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:08.321333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:08.321986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:08.322332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:08.322823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] PATH_INFO: `/v3/users/330f9f0be4434f9195ac453e5550ad29` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:08.323887 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=330f9f0be4434f9195ac453e5550ad29)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:08.325819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:08.510783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:08.517426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330f9f0be4434f9195ac453e5550ad29'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.526058 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330f9f0be4434f9195ac453e5550ad29'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.526741 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330f9f0be4434f9195ac453e5550ad29'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.527366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330f9f0be4434f9195ac453e5550ad29'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.542937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7319c66-be89-4fab-af27-086602ea2c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330f9f0be4434f9195ac453e5550ad29'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:08.621507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1331/2659] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:08 2022] DELETE /identity/v3/users/330f9f0be4434f9195ac453e5550ad29 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:08.907512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:08.926585 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0ef1-6cb6-4c8d-9fa3-68d16c155875 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.000580 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.001278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.001559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.001946 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] PATH_INFO: `/v3/projects/4d4e6306662c48288118048646104ca3` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.003164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4e6306662c48288118048646104ca3)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.005265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.148930 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4e6306662c48288118048646104ca3', 'request_id': 'req-80d155b2-b596-467d-b0ab-2f77367e02fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.159760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4e6306662c48288118048646104ca3', 'request_id': 'req-80d155b2-b596-467d-b0ab-2f77367e02fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.243103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4e6306662c48288118048646104ca3', 'request_id': 'req-80d155b2-b596-467d-b0ab-2f77367e02fc'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.251342 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:09.255502 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] The token cache is being invalidate because project 4d4e6306662c48288118048646104ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:09.256361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.257078 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-80d155b2-b596-467d-b0ab-2f77367e02fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:09.258701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1329/2660] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:08 2022] DELETE /identity/v3/projects/4d4e6306662c48288118048646104ca3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:09.264138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.264424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.264697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.321049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:09.322194 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:09.388586 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1332/2661] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:09.397810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.398220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.404361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.420056 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:09.421469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:09.431188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1330/2662] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:09.435562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.446048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211ef53-bcae-4ebe-83bf-f48df8311ba4 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.451123 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.451745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.452074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.452354 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.453050 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:09.453356 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.454960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.466958 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1333/2663] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:09.471482 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.481097 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694366b-91f3-4629-8c45-0339e8993df4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.485887 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.486492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.486774 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.487048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.487718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.489663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.594304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1331/2664] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:09 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:09.598716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.609933 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce94b-75e7-47b3-90b0-a840d52294a3 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.679862 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.680511 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.680797 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.681077 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.681782 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.683737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.798062 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1334/2665] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:09 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:09.803303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.814512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8b25b-7e70-4862-94db-7032795cf137 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.819735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.820406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.820689 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.820990 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.821702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.823364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.834616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1332/2666] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:09.840133 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.857948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8519b-8e04-453c-8bc8-68c4b4ec313e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.863982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.864620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.864903 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.865804 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.866487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.868260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72fad6-7ef4-48b2-b5db-bb095aea8321 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.874956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:09.884048 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1335/2667] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:09.894604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:09.906604 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b0ffa-b98e-46e5-8d84-e9e1166dad68 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:09.913597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:09.914287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:09.914564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:09.914932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] PATH_INFO: `/v3/projects/ed9c3d31b8d648fba6c157cb454ce48e/users/22dc0c277a58405bb72e935aee73dfa4/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:09.932628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9c3d31b8d648fba6c157cb454ce48e, user_id=22dc0c277a58405bb72e935aee73dfa4, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:09.935318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:09.998645 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1333/2668] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:09 2022] PUT /identity/v3/projects/ed9c3d31b8d648fba6c157cb454ce48e/users/22dc0c277a58405bb72e935aee73dfa4/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:10.003875 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a256b-4450-4547-9d0d-e8fe86a3ba02 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.004212 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a256b-4450-4547-9d0d-e8fe86a3ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.004493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a256b-4450-4547-9d0d-e8fe86a3ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.025464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-162a256b-4450-4547-9d0d-e8fe86a3ba02 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:10.026737 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-162a256b-4450-4547-9d0d-e8fe86a3ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.097921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1336/2669] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:10.108889 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:10.110656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:10.179154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed886e-f11d-47db-b553-629f5891b64a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:10.183205 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:10.183944 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:10.184229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:10.184504 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:10.195716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:10.197220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:10.208303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1334/2670] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:11.773315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.773315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.773315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.807602 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] MFA Rules not processed for user `22dc0c277a58405bb72e935aee73dfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:11.808917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:11.893470 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1337/2671] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:11.898262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:11.908472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26374130-fd00-49c6-b145-e01f52e3de58 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:11.913950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:11.914573 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:11.914855 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:11.915177 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:11.917316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:11.919291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.022051 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1335/2672] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:11 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:12.026404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.038556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa7ea-51cd-446e-b222-2ddcfb9514fd None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.102346 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.102973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.103255 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.103529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.104245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.106168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.220080 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1338/2673] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:12 2022] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:12.224037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.234367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2962322-e755-4db1-8c42-15a759703685 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.239145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.239775 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.240110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.240382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.241111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.242719 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.253439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1336/2674] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:12.259682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.271146 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab57e0-92f5-4e79-8030-8de421a5deda admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.276722 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.277542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.277822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.278096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] PATH_INFO: `/v3/projects/18e238a2caab4de685768fa7a4c1ae99/users/1a6a1253c02d49d9b88718282b9a9d6a/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.297306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e238a2caab4de685768fa7a4c1ae99, user_id=1a6a1253c02d49d9b88718282b9a9d6a, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.300109 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.303619 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:12.413957 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1339/2675] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:12 2022] PUT /identity/v3/projects/18e238a2caab4de685768fa7a4c1ae99/users/1a6a1253c02d49d9b88718282b9a9d6a/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:12.419781 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.431171 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988747b-6230-44e5-b074-e573520a87ac admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.495650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.496195 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.496481 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.496757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.497464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.499158 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fcff2-00c8-433e-b5fa-3242a27dee90 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.510533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1337/2676] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:12.515280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:12.526750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693e50b-fbd9-4864-952f-9e2125b7dd47 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:12.531428 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:12.532121 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:12.532400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:12.532674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] PATH_INFO: `/v3/projects/18e238a2caab4de685768fa7a4c1ae99/users/1a6a1253c02d49d9b88718282b9a9d6a/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:12.534620 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e238a2caab4de685768fa7a4c1ae99, user_id=1a6a1253c02d49d9b88718282b9a9d6a, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:12.537809 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:12.549474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1340/2677] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:12 2022] PUT /identity/v3/projects/18e238a2caab4de685768fa7a4c1ae99/users/1a6a1253c02d49d9b88718282b9a9d6a/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:14.062782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:14.063420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:14.063420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:14.071570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:14.097196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] MFA Rules not processed for user `1a6a1253c02d49d9b88718282b9a9d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:14.098561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:14.195808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1338/2678] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:16.027289 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.137429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e73e0-25af-4045-9085-2a074fa15ebd admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.145384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.146675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.147090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.147415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] PATH_INFO: `/v3/users/22dc0c277a58405bb72e935aee73dfa4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.148893 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dc0c277a58405bb72e935aee73dfa4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.150937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.445863 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dc0c277a58405bb72e935aee73dfa4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:16.456004 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dc0c277a58405bb72e935aee73dfa4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:16.457402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dc0c277a58405bb72e935aee73dfa4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:16.458280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dc0c277a58405bb72e935aee73dfa4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:16.473550 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dc0c277a58405bb72e935aee73dfa4'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:16.565547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.568296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.590555 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1341/2679] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:16 2022] DELETE /identity/v3/users/22dc0c277a58405bb72e935aee73dfa4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:16.673061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc09e7-8b39-47b5-a952-cdc0cda0f2c5 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:16.777271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:16.777919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:16.778206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:16.778600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:16.781152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:16.795140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:16.796897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:16.811141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1339/2680] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:26:16.924210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:16.926245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:17.045117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c329a38-f256-4e2c-b343-e3917d89df21 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:17.051972 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:17.056112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:17.056513 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:17.056802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] PATH_INFO: `/v3/projects/ed9c3d31b8d648fba6c157cb454ce48e` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:17.058465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9c3d31b8d648fba6c157cb454ce48e)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:17.060503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:17.063368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:17.195447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9c3d31b8d648fba6c157cb454ce48e', 'request_id': 'req-f0b56493-cc24-471f-b99c-b82270516e8e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.209347 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9c3d31b8d648fba6c157cb454ce48e', 'request_id': 'req-f0b56493-cc24-471f-b99c-b82270516e8e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.277301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9c3d31b8d648fba6c157cb454ce48e', 'request_id': 'req-f0b56493-cc24-471f-b99c-b82270516e8e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.290932 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] The token cache is being invalidate because project ed9c3d31b8d648fba6c157cb454ce48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:17.291206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.291872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.293503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1342/2681] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:16 2022] DELETE /identity/v3/projects/ed9c3d31b8d648fba6c157cb454ce48e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:17.297752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:17.313060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf04d-e7cb-44e1-b972-71503d67b4d6 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:17.331294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:17.379874 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:17.383014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:17.383014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:17.383014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] PATH_INFO: `/v3/users/1a6a1253c02d49d9b88718282b9a9d6a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:17.384498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6a1253c02d49d9b88718282b9a9d6a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:17.385119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:17.640677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6a1253c02d49d9b88718282b9a9d6a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.647886 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6a1253c02d49d9b88718282b9a9d6a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.648601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6a1253c02d49d9b88718282b9a9d6a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.660362 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6a1253c02d49d9b88718282b9a9d6a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.773932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c6d262b2-13e1-469c-946f-fd36f0bf0d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6a1253c02d49d9b88718282b9a9d6a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:17.780931 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1340/2682] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:26:17 2022] DELETE /identity/v3/users/1a6a1253c02d49d9b88718282b9a9d6a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:18.039021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.040674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:18.061407 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b56493-cc24-471f-b99c-b82270516e8e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.143061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.144281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.144742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.145201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] PATH_INFO: `/v3/projects/18e238a2caab4de685768fa7a4c1ae99` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.148374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e238a2caab4de685768fa7a4c1ae99)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.151967 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.302054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e238a2caab4de685768fa7a4c1ae99', 'request_id': 'req-cda80a82-dd1d-4eca-973d-96e467d57d14'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:18.309910 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e238a2caab4de685768fa7a4c1ae99', 'request_id': 'req-cda80a82-dd1d-4eca-973d-96e467d57d14'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:18.391149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e238a2caab4de685768fa7a4c1ae99', 'request_id': 'req-cda80a82-dd1d-4eca-973d-96e467d57d14'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:18.408693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] The token cache is being invalidate because project 18e238a2caab4de685768fa7a4c1ae99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:26:18.408988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:18.409653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-cda80a82-dd1d-4eca-973d-96e467d57d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:26:18.411202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1343/2683] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:26:18 2022] DELETE /identity/v3/projects/18e238a2caab4de685768fa7a4c1ae99 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:18.417154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.417442 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.417753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.438853 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:18.440066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:18.507249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1341/2684] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:18.515937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.516224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.516509 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.542137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:18.543507 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:18.556084 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1344/2685] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:18.560679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.573474 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfa3f0-796c-49d9-8300-92eed535df1a None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.578707 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.579431 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.579823 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.580212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.580910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:26:18.581213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.582934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.597269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1342/2686] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:26:18.602836 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.612890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fbcae-bf0b-4260-a2d8-004ac5f81d0a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.618294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.618984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.619269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.619548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.620324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.622295 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:18.639878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:18.779455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1345/2687] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:18.784192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:18.797145 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c489f-c58a-476d-9189-f196426ac8a5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:18.833007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:18.884407 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:18.885453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:18.885962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:18.886516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:18.889178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:18.900472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.006728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1343/2688] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:18 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:19.016092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.024575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571f10-8591-4a48-90be-fc3ad53e6e95 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.032086 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.032724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.033000 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.033271 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.033968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.035927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.048583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1346/2689] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:19.051464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.062724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454913-68b5-4d5c-af51-9e92771327fa admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.067584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.073837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.073837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.073837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.073837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.073837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64b15-a7bd-4748-ab28-588ce4349c9b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.085638 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1344/2690] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:19.090079 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.100761 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faf774-433d-4199-8093-76ec3d39a0c4 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.105596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.106286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.106570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.106851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] PATH_INFO: `/v3/projects/6a4eb8cec6684e8481db4dd3e75b66f1/users/9f3391cfba8c480b8819f816b51afa12/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.125019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4eb8cec6684e8481db4dd3e75b66f1, user_id=9f3391cfba8c480b8819f816b51afa12, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.128160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.220655 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1347/2691] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:19 2022] PUT /identity/v3/projects/6a4eb8cec6684e8481db4dd3e75b66f1/users/9f3391cfba8c480b8819f816b51afa12/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:19.232461 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.232767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.233225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.265854 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] MFA Rules not processed for user `9f3391cfba8c480b8819f816b51afa12`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:19.267094 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:19.361306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1345/2692] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:19.369953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.477051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077eb6a-e4e7-4a12-8f5f-db349c740582 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.482075 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.482706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.482984 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.483254 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.484013 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.485871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.590439 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1348/2693] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:26:19 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:26:19.597003 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.611745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319da54-4516-413d-b3e3-8991f73e7717 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.675861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.676651 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.676932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.677314 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.678189 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.680182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.780608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1346/2694] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:26:19 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:26:19.784727 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.795594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e7b3-481a-4049-99db-8796af04163f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.800518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.801391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.801700 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.801977 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.802718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.804405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.815878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1349/2695] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:19.820977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.831880 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef84d-a6a6-480f-81e6-619615aa4a05 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:19.838614 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:19.839338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:19.839624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:19.839921 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] PATH_INFO: `/v3/projects/778d6952e84345bb98050a54c1abdf49/users/3cd9e395f43044139a1b286ab6355476/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:19.858581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778d6952e84345bb98050a54c1abdf49, user_id=3cd9e395f43044139a1b286ab6355476, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:19.862747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:19.953029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:19.965918 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1347/2696] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:19 2022] PUT /identity/v3/projects/778d6952e84345bb98050a54c1abdf49/users/3cd9e395f43044139a1b286ab6355476/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:26:19.970220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:19.987358 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ff94-9ded-4b8b-8e7a-b3a4b87784c2 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.059474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.060156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.060430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.060710 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.061411 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.063168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4d70-386c-47a9-a56b-1305e4a9a7bb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.081723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1350/2697] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:26:20.083162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.095427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca4459-3f52-440e-a84e-41bcce79c471 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.101444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.102305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.102696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.103071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] PATH_INFO: `/v3/projects/778d6952e84345bb98050a54c1abdf49/users/3cd9e395f43044139a1b286ab6355476/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.105472 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=778d6952e84345bb98050a54c1abdf49, user_id=3cd9e395f43044139a1b286ab6355476, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.108834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.127173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1348/2698] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:26:20 2022] PUT /identity/v3/projects/778d6952e84345bb98050a54c1abdf49/users/3cd9e395f43044139a1b286ab6355476/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:26:20.138566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.139141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.139141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.171787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] MFA Rules not processed for user `3cd9e395f43044139a1b286ab6355476`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:20.173113 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.192611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:20.249846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1351/2699] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:26:20.261300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.263074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.354938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d9137-f7c7-467c-8e76-7fd9727ce1ca admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.358919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.359554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.359832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.360139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.373241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.376029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe4396-b8f3-482c-9522-156204d4a5ef service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.393381 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1349/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:20.632147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:26:20.634613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:20.654144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43669a6f-bce4-44e9-8f44-3df95a6b86cc None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:26:20.659371 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:26:20.660481 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:20.660962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:20.661389 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:20.766353 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:26:20.769039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:26:20.787734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1352/2701] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:26:30.217830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9939b96-d8e2-43a1-8088-e37b351d33cc None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:26:30.218398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9939b96-d8e2-43a1-8088-e37b351d33cc None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:26:30.218398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9939b96-d8e2-43a1-8088-e37b351d33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:26:30.240968 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-c9939b96-d8e2-43a1-8088-e37b351d33cc None None] MFA Rules not processed for user `510f23f44f1d43818107af0e25de0ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:26:30.242225 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c9939b96-d8e2-43a1-8088-e37b351d33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:26:30.305341 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1350/2702] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:26:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:26:30.779547 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=49 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:26:40.297919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:02.336695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:02.418687 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388aacd-c7a9-4b2d-a344-baf801f55cf2 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:02.424066 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:02.424742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:02.425035 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:02.425301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] PATH_INFO: `/v3/users/9f3391cfba8c480b8819f816b51afa12` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:02.426771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3391cfba8c480b8819f816b51afa12)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:02.428795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:02.630915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3391cfba8c480b8819f816b51afa12'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.641060 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3391cfba8c480b8819f816b51afa12'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.641818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3391cfba8c480b8819f816b51afa12'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.642452 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3391cfba8c480b8819f816b51afa12'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.657609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3391cfba8c480b8819f816b51afa12'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:02.740164 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1353/2703] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:02 2022] DELETE /identity/v3/users/9f3391cfba8c480b8819f816b51afa12 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:02.746599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:02.747209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:02.747209 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:02.771842 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:02.775523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:02.857967 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1351/2704] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:02.870223 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:02.871732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:02.940944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6bd26-723a-475b-ab53-d0a8b1348294 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:02.945676 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:02.946314 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:02.946597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:02.946922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:02.958715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:02.960238 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:02.971925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1354/2705] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:03.433790 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:03.435765 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:03.451834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7827-ab31-4ca0-9724-35f1dad82876 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:03.457724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:03.459093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:03.459427 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:03.459736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] PATH_INFO: `/v3/projects/6a4eb8cec6684e8481db4dd3e75b66f1` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:03.461214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4eb8cec6684e8481db4dd3e75b66f1)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:03.463869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:03.607562 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4eb8cec6684e8481db4dd3e75b66f1', 'request_id': 'req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.616037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4eb8cec6684e8481db4dd3e75b66f1', 'request_id': 'req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.670154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4eb8cec6684e8481db4dd3e75b66f1', 'request_id': 'req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.690367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] The token cache is being invalidate because project 6a4eb8cec6684e8481db4dd3e75b66f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:03.690884 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.692118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:03.695268 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1352/2706] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:03 2022] DELETE /identity/v3/projects/6a4eb8cec6684e8481db4dd3e75b66f1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:03.701983 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:03.720692 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4244cfb-ad49-4f3f-a29f-80ae772be5c1 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:03.747172 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:03.793971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:03.794641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:03.794927 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:03.795210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] PATH_INFO: `/v3/users/3cd9e395f43044139a1b286ab6355476` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:03.796605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd9e395f43044139a1b286ab6355476)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:03.798671 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:04.000016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd9e395f43044139a1b286ab6355476'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.009308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd9e395f43044139a1b286ab6355476'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.010178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd9e395f43044139a1b286ab6355476'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.010841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd9e395f43044139a1b286ab6355476'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.027841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-26195f61-72aa-4d7d-b181-89e7abf2ad96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd9e395f43044139a1b286ab6355476'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.145625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1355/2707] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:03 2022] DELETE /identity/v3/users/3cd9e395f43044139a1b286ab6355476 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:04.673792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:04.675888 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:04.693868 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b2f1-ae8a-481f-ace2-14bc55e5dfce admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:04.782327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:04.782861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:04.783138 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:04.783411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] PATH_INFO: `/v3/projects/778d6952e84345bb98050a54c1abdf49` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:04.784871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778d6952e84345bb98050a54c1abdf49)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:04.787784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:04.894373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:04.915048 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778d6952e84345bb98050a54c1abdf49', 'request_id': 'req-a98cb892-7fbf-4b65-b302-60f3d88a0b44'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.923477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778d6952e84345bb98050a54c1abdf49', 'request_id': 'req-a98cb892-7fbf-4b65-b302-60f3d88a0b44'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:04.995452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778d6952e84345bb98050a54c1abdf49', 'request_id': 'req-a98cb892-7fbf-4b65-b302-60f3d88a0b44'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:05.009164 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] The token cache is being invalidate because project 778d6952e84345bb98050a54c1abdf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:05.009454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:05.010117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-a98cb892-7fbf-4b65-b302-60f3d88a0b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:05.011843 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1353/2708] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:04 2022] DELETE /identity/v3/projects/778d6952e84345bb98050a54c1abdf49 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:05.023214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.023214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.023214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.044026 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:05.045348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:05.116729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1356/2709] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:05.126602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.126939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.127259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.151841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:05.153279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:05.162623 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1354/2710] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:05.167778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.184163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fedd6-fd22-424a-985c-fed26007d29a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.189403 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.190082 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.190405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.190677 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.191402 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:05.193068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.194878 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.209383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1357/2711] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:05.214264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.225830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f08b-898d-4f0e-ac38-9552923fdfbb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.231196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.231876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.232252 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.232574 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.233329 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.235459 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.336264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1355/2712] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:05.340860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.352995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e715a53-cfca-497e-a453-7fbc97a6ce99 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.384838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:05.429185 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.430258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.430779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.431292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.432508 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.436292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.539390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1358/2713] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:05.544877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.557780 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b7cf-73c7-4d5e-b2d9-4f7cf464f256 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.562695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.563333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.563616 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.563893 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.564634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.566954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.578454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1356/2714] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:05.584391 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.595860 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde75eb-7458-44a0-8d6e-b90cbd545111 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.601639 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.602284 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.602561 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.602834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.603649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.605367 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece43dcb-0737-48e6-a44c-c4341b78bfef admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.618539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1359/2715] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:05.623068 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:05.636232 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876e251-74fa-48d0-910e-e7a32ddbd21a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:05.641321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:05.642007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.642316 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.642565 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] PATH_INFO: `/v3/projects/f39bcb2e643541b8a727fe478312bd3b/users/d84c9c1edcac4d118182b87ad0a4015a/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.662513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39bcb2e643541b8a727fe478312bd3b, user_id=d84c9c1edcac4d118182b87ad0a4015a, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:05.666184 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:05.805494 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1357/2716] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:05 2022] PUT /identity/v3/projects/f39bcb2e643541b8a727fe478312bd3b/users/d84c9c1edcac4d118182b87ad0a4015a/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:05.817593 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:05.817857 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:05.818130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:05.850614 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] MFA Rules not processed for user `d84c9c1edcac4d118182b87ad0a4015a`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:05.851773 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:05.924825 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1360/2717] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:05.930148 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.003631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0281-af25-4719-97dd-e9b6a7f227e6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.009917 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.010984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.011400 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.011697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.012876 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.015131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.134554 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1358/2718] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:05 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:06.139170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.153774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81596-4f06-46c0-933a-c9549150ec36 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.230160 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.230808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.231092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.231361 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.232095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.234059 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.323660 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1361/2719] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:06.328287 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.342498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb3954-3fe6-4242-9f7a-67f7fc95d5eb admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.347575 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.349336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.349782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.350194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.350928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.352612 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.366950 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1359/2720] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:06.372912 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.392716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd8ce-a041-4626-ad80-a43af4edaf0f admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.401800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.403006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.403518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.404057 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] PATH_INFO: `/v3/projects/f5c8c84b46d2468aaa40920aaedb0789/users/f592da682d204cc1b9d3264f8fd61035/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.424608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c8c84b46d2468aaa40920aaedb0789, user_id=f592da682d204cc1b9d3264f8fd61035, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.428410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.513316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1362/2721] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:06 2022] PUT /identity/v3/projects/f5c8c84b46d2468aaa40920aaedb0789/users/f592da682d204cc1b9d3264f8fd61035/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:06.519529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.531771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37587453-ae0e-47a4-997f-cad0b9eb1ff8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.556667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:06.602945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.603582 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.603859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.604347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.605113 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.606961 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f082c0-3094-4ebc-ae2e-32d32a91c2f8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.622532 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1360/2722] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:06.627750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.635225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:06.641330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec70ff-05c9-4f1f-864c-d4791819b7ee admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.647303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.648101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.648395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.648667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] PATH_INFO: `/v3/projects/f5c8c84b46d2468aaa40920aaedb0789/users/f592da682d204cc1b9d3264f8fd61035/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.650815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c8c84b46d2468aaa40920aaedb0789, user_id=f592da682d204cc1b9d3264f8fd61035, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.653534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.668120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1363/2723] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:06 2022] PUT /identity/v3/projects/f5c8c84b46d2468aaa40920aaedb0789/users/f592da682d204cc1b9d3264f8fd61035/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:06.681175 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.681564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.681882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.719786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] MFA Rules not processed for user `f592da682d204cc1b9d3264f8fd61035`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:06.721101 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:06.833473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1361/2724] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:06.846729 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:06.850274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:06.927009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02276-8a34-449c-987b-08dffb59f467 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:06.930712 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:06.931427 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:06.931754 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:06.932129 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:06.944506 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:06.946256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:06.958757 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1364/2725] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:08.098271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.108026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a2147-cdd2-4a80-ac92-436865d39fcb None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.112951 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f592da682d204cc1b9d3264f8fd61035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5c8c84b46d2468aaa40920aaedb0789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.113745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.114029 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.114302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.115017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:08.115322 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.117016 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.131069 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1362/2726] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:08.136448 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.151640 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09288d-ca7e-44b4-baf2-4ec9f7c5f8f6 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.157126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f592da682d204cc1b9d3264f8fd61035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5c8c84b46d2468aaa40920aaedb0789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.157823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.158154 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.158471 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.159206 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.162108 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.283594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1365/2727] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:08 2022] POST /identity/v3/projects => generated 354 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:08.288064 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.298492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9471a-fcbe-4d48-822c-5d7b564a818d tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.365349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f592da682d204cc1b9d3264f8fd61035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5c8c84b46d2468aaa40920aaedb0789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.366007 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.366290 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.366571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.367301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:08.367611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.369344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.384879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1363/2728] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:27:08.428170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:08.442800 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ba13-c03f-4e42-9e1d-c82f99785cee tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:08.450052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f592da682d204cc1b9d3264f8fd61035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5c8c84b46d2468aaa40920aaedb0789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:08.451106 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:08.451464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:08.451851 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] PATH_INFO: `/v3/projects/36404216731f416ab5ae477c58daecad` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:08.453359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36404216731f416ab5ae477c58daecad)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:08.455469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:08.605280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36404216731f416ab5ae477c58daecad', 'request_id': 'req-f7312b1a-4824-4591-bd55-bed45438882e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.612938 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36404216731f416ab5ae477c58daecad', 'request_id': 'req-f7312b1a-4824-4591-bd55-bed45438882e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.704237 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36404216731f416ab5ae477c58daecad', 'request_id': 'req-f7312b1a-4824-4591-bd55-bed45438882e'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.718990 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] The token cache is being invalidate because project 36404216731f416ab5ae477c58daecad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:08.725581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.725581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f7312b1a-4824-4591-bd55-bed45438882e tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:08.725581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1366/2729] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:08 2022] DELETE /identity/v3/projects/36404216731f416ab5ae477c58daecad => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:09.470059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:09.471841 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:09.509182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:09.552743 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f3b4-6bde-4c6a-9f4d-3b432f08b002 tempest-VolumeQuotaClassesTest-1585486779 tempest-VolumeQuotaClassesTest-1585486779-project-admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:09.622117 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:09.624800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.624800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.624800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] PATH_INFO: `/v3/users/d84c9c1edcac4d118182b87ad0a4015a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.625282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84c9c1edcac4d118182b87ad0a4015a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:09.627087 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:09.845704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84c9c1edcac4d118182b87ad0a4015a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.854468 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84c9c1edcac4d118182b87ad0a4015a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.855262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84c9c1edcac4d118182b87ad0a4015a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.869350 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84c9c1edcac4d118182b87ad0a4015a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.944009 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84c9c1edcac4d118182b87ad0a4015a'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:09.951551 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1364/2730] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:09 2022] DELETE /identity/v3/users/d84c9c1edcac4d118182b87ad0a4015a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:09.956536 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:09.957317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:09.957317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:09.980355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:09.981715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.042298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:10.058803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1367/2731] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:10.070559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.072126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.141822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db15ac7-588e-48a2-a388-86a30ccbb460 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.147544 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.148648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.149131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.149615 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.163525 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:10.166890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.170005 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.189570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1365/2732] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:10.669137 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.671613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:10.696240 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60d1ed-708c-4558-99af-99a75e0ca8da None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:10.711134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:10.712375 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:10.713201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:10.713901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] PATH_INFO: `/v3/projects/f39bcb2e643541b8a727fe478312bd3b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:10.716245 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39bcb2e643541b8a727fe478312bd3b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:10.720039 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:10.847241 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39bcb2e643541b8a727fe478312bd3b', 'request_id': 'req-ea09e659-5728-431f-b860-9edfc6124bcb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.856464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39bcb2e643541b8a727fe478312bd3b', 'request_id': 'req-ea09e659-5728-431f-b860-9edfc6124bcb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.938491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39bcb2e643541b8a727fe478312bd3b', 'request_id': 'req-ea09e659-5728-431f-b860-9edfc6124bcb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.953252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] The token cache is being invalidate because project f39bcb2e643541b8a727fe478312bd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:10.953596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.954260 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:10.955882 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1368/2733] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:10 2022] DELETE /identity/v3/projects/f39bcb2e643541b8a727fe478312bd3b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:10.962074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:10.980402 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684332b-a5df-4651-9ecc-2c524bde6ecc service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:11.065194 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:11.066291 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:11.067564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:11.068120 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] PATH_INFO: `/v3/users/f592da682d204cc1b9d3264f8fd61035` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:11.070393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f592da682d204cc1b9d3264f8fd61035)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:11.074471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:11.315326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f592da682d204cc1b9d3264f8fd61035'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:11.324456 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f592da682d204cc1b9d3264f8fd61035'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:11.325231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f592da682d204cc1b9d3264f8fd61035'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:11.340776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f592da682d204cc1b9d3264f8fd61035'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:11.401253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c24c4e98-b005-4b5b-9ff4-2f655148193b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f592da682d204cc1b9d3264f8fd61035'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:11.408570 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1366/2734] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:10 2022] DELETE /identity/v3/users/f592da682d204cc1b9d3264f8fd61035 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:11.975315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:11.977854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:11.999734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09e659-5728-431f-b860-9edfc6124bcb admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:12.072625 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:12.073445 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.073870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.074263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] PATH_INFO: `/v3/projects/f5c8c84b46d2468aaa40920aaedb0789` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.075949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c8c84b46d2468aaa40920aaedb0789)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:12.078204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:12.282520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c8c84b46d2468aaa40920aaedb0789', 'request_id': 'req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:12.295631 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c8c84b46d2468aaa40920aaedb0789', 'request_id': 'req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:12.492538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c8c84b46d2468aaa40920aaedb0789', 'request_id': 'req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:12.506552 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] The token cache is being invalidate because project f5c8c84b46d2468aaa40920aaedb0789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:12.506905 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:12.507524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-70a2a5f4-5b62-40a0-bbe1-5c6de371cb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:12.509243 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1369/2735] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:11 2022] DELETE /identity/v3/projects/f5c8c84b46d2468aaa40920aaedb0789 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:12.515265 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.515878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.515878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.539077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:12.540403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:12.612111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1367/2736] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:12.622792 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.623085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.623393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.640681 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:12.647076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:12.648390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:12.656814 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1370/2737] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:12.661782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:12.672372 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4ba33-4480-4725-aadb-8bf6d8af047b None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:12.678607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:12.679317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.679667 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.679976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.680752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:12.681053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:12.682724 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:12.697061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1368/2738] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:27:12.702280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:12.716069 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b047e-3c85-4d41-945c-aafce9635d2e None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:12.721566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:12.723126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.723613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.724324 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.725272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:12.729073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:12.844309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1371/2739] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:12 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:12.849453 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:12.854835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:12.861187 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396879-d9b3-4147-9550-7ad13cc29680 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:12.929678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:12.930304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:12.930583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:12.930856 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:12.931536 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:12.933557 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.076300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1369/2740] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:12 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:13.080841 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.093723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235d2a4-69d2-4522-8892-afe5b2f43ccc admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.099982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.100529 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.100811 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.101092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.101816 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.103661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.117601 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1372/2741] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:13.122833 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.134561 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4c2b-e6a4-4a96-8b20-eff90b6313b8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.140185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.140867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.141153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.141430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.142207 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.143857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0764c36-8aa7-4289-8a6d-dd09a2a41db4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.156899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1370/2742] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:13.164003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.177188 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e451f-e153-4f68-9310-c3ce613b1742 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.183542 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.184476 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.190693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.190693 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] PATH_INFO: `/v3/projects/8580b54ce6f84f15b76acb58a258812a/users/c1320ed3cbfe49cab108bb2cbbe4b054/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.206291 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8580b54ce6f84f15b76acb58a258812a, user_id=c1320ed3cbfe49cab108bb2cbbe4b054, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.209474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.322210 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1373/2743] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:13 2022] PUT /identity/v3/projects/8580b54ce6f84f15b76acb58a258812a/users/c1320ed3cbfe49cab108bb2cbbe4b054/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:13.333244 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.336338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.336338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.366506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] MFA Rules not processed for user `c1320ed3cbfe49cab108bb2cbbe4b054`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:13.367767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:13.454718 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1371/2744] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:13.460277 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.539880 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2e7a-4c18-46f1-959b-cff190d91a7e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.548220 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.549330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.549838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.550342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.551644 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.555168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.661153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1374/2745] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:13 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:27:13.666332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.682455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae8cd-f497-4546-a6c6-25933e636ac4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.783633 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.784744 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.785785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.786271 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.787507 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.790955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.899608 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:13.905346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1372/2746] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:13 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:13.911830 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.923502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed66b-eee8-443c-b799-9c76f00d47a7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.929638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.932224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.932224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.932224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.932224 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.933348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:13.947425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1375/2747] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:13.952716 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:13.965952 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab990e5-8a57-4f10-ba8e-5cd930745676 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:13.971448 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:13.972178 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:13.972812 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:13.973294 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] PATH_INFO: `/v3/projects/31ad515d79ee445896bce5e4ce26990f/users/0b6dc3b0b89843aca1f0f9b798ffb77b/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:13.992770 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ad515d79ee445896bce5e4ce26990f, user_id=0b6dc3b0b89843aca1f0f9b798ffb77b, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:13.995740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:14.117050 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1373/2748] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:13 2022] PUT /identity/v3/projects/31ad515d79ee445896bce5e4ce26990f/users/0b6dc3b0b89843aca1f0f9b798ffb77b/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:14.122052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:14.140422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f096-e1dd-4a41-bb6c-6a7ad91a8848 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:14.215605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:14.216134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.216419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.216691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.217419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:14.219248 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302067e9-3145-4b1d-b955-ceea7832ef15 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:14.238046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1376/2749] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:14.243237 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:14.256034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3df7e8-14ce-4d13-a49c-38fc6c7c81e9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:14.261173 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:14.261860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.262139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.262412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] PATH_INFO: `/v3/projects/31ad515d79ee445896bce5e4ce26990f/users/0b6dc3b0b89843aca1f0f9b798ffb77b/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.264891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ad515d79ee445896bce5e4ce26990f, user_id=0b6dc3b0b89843aca1f0f9b798ffb77b, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:14.267658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:14.281940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1374/2750] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:14 2022] PUT /identity/v3/projects/31ad515d79ee445896bce5e4ce26990f/users/0b6dc3b0b89843aca1f0f9b798ffb77b/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:14.295328 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.295734 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.296201 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.340894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:14.346985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] MFA Rules not processed for user `0b6dc3b0b89843aca1f0f9b798ffb77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:14.353682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:14.480101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1377/2751] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:14.493049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:14.494862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:14.563433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c6199-a7c9-4ce6-b9b6-d6cd7cb74cb3 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:14.568042 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:14.568691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:14.568974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:14.569249 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:14.579920 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:14.581406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866ec8-46ef-4a79-a8d0-01114c3df3e6 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:14.593440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1375/2752] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:15.845540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:15.912974 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa66c6-4ecf-4693-ac52-373179c484eb None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:15.918384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:15.919074 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:15.919366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:15.919594 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] PATH_INFO: `/v3/users/c1320ed3cbfe49cab108bb2cbbe4b054` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:15.920832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1320ed3cbfe49cab108bb2cbbe4b054)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:15.922785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:16.147752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1320ed3cbfe49cab108bb2cbbe4b054'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:16.155049 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1320ed3cbfe49cab108bb2cbbe4b054'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:16.155798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1320ed3cbfe49cab108bb2cbbe4b054'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:16.156449 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1320ed3cbfe49cab108bb2cbbe4b054'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:16.170503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1320ed3cbfe49cab108bb2cbbe4b054'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:16.287199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1378/2753] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:15 2022] DELETE /identity/v3/users/c1320ed3cbfe49cab108bb2cbbe4b054 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:16.292471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:16.292983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:16.293086 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:16.316948 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:16.318192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:16.392368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1376/2754] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:16.402874 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:16.404333 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:16.427384 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:16.493274 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76418b5e-6f9c-4f1c-8317-ae2fbf512a58 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:16.497181 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:16.497813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:16.498098 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:16.498374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:16.509192 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:16.510654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:16.522487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1379/2755] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:17.089563 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:17.091455 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:17.119052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc6ba-0800-47a1-9686-bab0b60792a3 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:17.139458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:17.140374 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:17.140771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:17.141081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] PATH_INFO: `/v3/projects/8580b54ce6f84f15b76acb58a258812a` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:17.143366 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8580b54ce6f84f15b76acb58a258812a)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:17.146801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:17.282058 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8580b54ce6f84f15b76acb58a258812a', 'request_id': 'req-c3a324f7-506a-4fd7-8954-a8541138ca6f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.289847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8580b54ce6f84f15b76acb58a258812a', 'request_id': 'req-c3a324f7-506a-4fd7-8954-a8541138ca6f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.401356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8580b54ce6f84f15b76acb58a258812a', 'request_id': 'req-c3a324f7-506a-4fd7-8954-a8541138ca6f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.403493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:17.414919 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] The token cache is being invalidate because project 8580b54ce6f84f15b76acb58a258812a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:17.420537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.420537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.420537 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1377/2756] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:17 2022] DELETE /identity/v3/projects/8580b54ce6f84f15b76acb58a258812a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:17.422168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:17.435492 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfdb8-e206-449f-a142-1018ccbe3620 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:17.501169 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:17.501831 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:17.502128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:17.502400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] PATH_INFO: `/v3/users/0b6dc3b0b89843aca1f0f9b798ffb77b` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:17.504330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6dc3b0b89843aca1f0f9b798ffb77b)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:17.506355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:17.728556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6dc3b0b89843aca1f0f9b798ffb77b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.738695 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6dc3b0b89843aca1f0f9b798ffb77b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.739159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6dc3b0b89843aca1f0f9b798ffb77b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.739832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6dc3b0b89843aca1f0f9b798ffb77b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.752953 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2c5e50dc-f4b2-4320-88de-c1bddf2b1237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6dc3b0b89843aca1f0f9b798ffb77b'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:17.841187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1380/2757] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:17 2022] DELETE /identity/v3/users/0b6dc3b0b89843aca1f0f9b798ffb77b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:18.295301 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:18.297179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:18.312940 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a324f7-506a-4fd7-8954-a8541138ca6f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:18.414124 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:18.414974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:18.415126 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:18.415330 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] PATH_INFO: `/v3/projects/31ad515d79ee445896bce5e4ce26990f` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:18.416696 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ad515d79ee445896bce5e4ce26990f)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:18.418653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:18.536690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ad515d79ee445896bce5e4ce26990f', 'request_id': 'req-fef9db51-a62e-4d1c-9362-34e4f23c37ae'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:18.544736 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ad515d79ee445896bce5e4ce26990f', 'request_id': 'req-fef9db51-a62e-4d1c-9362-34e4f23c37ae'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:18.623960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ad515d79ee445896bce5e4ce26990f', 'request_id': 'req-fef9db51-a62e-4d1c-9362-34e4f23c37ae'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:18.637550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] The token cache is being invalidate because project 31ad515d79ee445896bce5e4ce26990f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:18.637906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:18.638816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-fef9db51-a62e-4d1c-9362-34e4f23c37ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:18.640492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1378/2758] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:18 2022] DELETE /identity/v3/projects/31ad515d79ee445896bce5e4ce26990f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:18.646713 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:18.650298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:18.650298 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:18.668312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:18.674497 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:18.711776 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:18.740948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1381/2759] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:18.749778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:18.750067 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:18.750327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:18.771772 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:18.773053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:18.781529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1379/2760] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:18.786975 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:18.799338 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f085-a4c1-4891-a392-86610ae69fc2 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:18.804340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:18.805130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:18.805412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:18.805691 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:18.806400 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:27:18.806735 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:18.808609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:18.821155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1382/2761] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:27:18.826284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:18.842857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312e656-283b-4cfc-bdf1-f0fd178ee577 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:18.851174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:18.852289 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:18.852802 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:18.853309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:18.854386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:18.856363 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:18.955686 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1380/2762] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:18.960925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:18.972883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b547-d415-42ba-b4fb-df596ca80fdd admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.044961 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.045608 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.047971 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.048263 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.051482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.054302 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.172986 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1383/2763] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:27:18 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:27:19.177390 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.188433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a857-b3d7-44ab-9e5b-17519d201390 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.195247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.195896 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.196263 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.196546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.197282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.198925 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.211409 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1381/2764] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:27:19.219463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.236891 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e1b7-3d85-46d0-a127-5967f8edd9c7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.242222 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.242871 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.243171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.243432 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.244178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.245988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eefdf2-b4dc-4d91-a688-856b54345b17 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.258575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1384/2765] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:27:19.263428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.274452 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e116b5-b414-4f47-8d84-1d984a88dc2b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.279129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.279819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.280140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.280412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] PATH_INFO: `/v3/projects/4b577cba7ddf4390ad4a0f11d34e0319/users/8732ce7648ec4b1eb39b1f625c4fd5eb/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.298817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b577cba7ddf4390ad4a0f11d34e0319, user_id=8732ce7648ec4b1eb39b1f625c4fd5eb, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.301926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.482309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1382/2766] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:27:19 2022] PUT /identity/v3/projects/4b577cba7ddf4390ad4a0f11d34e0319/users/8732ce7648ec4b1eb39b1f625c4fd5eb/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:19.500844 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.501281 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.501674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.536419 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] MFA Rules not processed for user `8732ce7648ec4b1eb39b1f625c4fd5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:19.538015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.614564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1385/2767] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:27:19.645349 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:19.647191 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:19.669875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:19.714863 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076476b7-111d-474e-a46f-f7ae13724ec4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:19.718804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:19.719528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:19.720186 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:19.720539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:19.731131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:19.733825 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aea83-5f0e-4808-889c-18e23e0e7dfd service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:19.743152 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1383/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:29.611152 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:29.801132 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=19 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:31.982031 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:32.061768 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf76a4-accf-4126-b8f4-dc84d493f0f9 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:32.068374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:32.069064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:32.069315 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:32.069591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] PATH_INFO: `/v3/users/8732ce7648ec4b1eb39b1f625c4fd5eb` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:32.070818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8732ce7648ec4b1eb39b1f625c4fd5eb)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:32.072885 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:32.281745 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8732ce7648ec4b1eb39b1f625c4fd5eb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:32.290187 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8732ce7648ec4b1eb39b1f625c4fd5eb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:32.290934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8732ce7648ec4b1eb39b1f625c4fd5eb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:32.291553 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8732ce7648ec4b1eb39b1f625c4fd5eb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:32.307548 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8732ce7648ec4b1eb39b1f625c4fd5eb'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:32.417834 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1386/2769] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:27:31 2022] DELETE /identity/v3/users/8732ce7648ec4b1eb39b1f625c4fd5eb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:27:32.422438 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:32.422962 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:32.423065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:32.444851 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:32.449817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:32.511676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1384/2770] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:32.522091 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:32.523628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:32.596457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d8931-e96a-4f77-b222-c976001fd97a admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:32.600667 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:32.601303 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:32.601583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:32.601858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:32.612006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:32.614114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c787-c6f5-4401-a126-0e3eb6caf492 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:32.624859 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1387/2771] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:33.121828 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:33.123273 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:33.136102 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe80a6-7354-4033-a448-5cb2cf5ea2c1 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:33.142044 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:33.142628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:33.142907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:33.143182 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] PATH_INFO: `/v3/projects/4b577cba7ddf4390ad4a0f11d34e0319` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:33.145439 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b577cba7ddf4390ad4a0f11d34e0319)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:33.147593 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:33.312049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b577cba7ddf4390ad4a0f11d34e0319', 'request_id': 'req-bbfd1394-cbdb-4736-9d61-514871463d57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:33.320584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b577cba7ddf4390ad4a0f11d34e0319', 'request_id': 'req-bbfd1394-cbdb-4736-9d61-514871463d57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:33.400404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b577cba7ddf4390ad4a0f11d34e0319', 'request_id': 'req-bbfd1394-cbdb-4736-9d61-514871463d57'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:33.412591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] The token cache is being invalidate because project 4b577cba7ddf4390ad4a0f11d34e0319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:27:33.413490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:33.413687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:27:33.415256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1385/2772] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:27:33 2022] DELETE /identity/v3/projects/4b577cba7ddf4390ad4a0f11d34e0319 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:27:36.397725 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:36.398323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:36.398323 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:36.418383 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] MFA Rules not processed for user `510f23f44f1d43818107af0e25de0ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:27:36.419632 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:36.438425 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:36.481053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1388/2773] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:27:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:27:43.408787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:45.223795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:45.225458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:45.289506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd1394-cbdb-4736-9d61-514871463d57 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:45.293258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:45.293877 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:45.294166 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:45.294521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:45.296361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:45.392081 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:45.393683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:45.416328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1386/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:27:46.629313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=15 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:27:50.187156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:27:50.188595 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:50.200719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747991b-cf6e-4f97-946b-6253b6378021 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:27:50.204326 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:27:50.204936 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:27:50.205218 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:27:50.205493 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:27:50.207750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:27:50.221940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:27:50.223369 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:27:50.234627 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1389/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:27:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:27:55.413592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=66 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:00.229610 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=6 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:33.858154 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:33.864735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:33.898521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a680-a5a6-43ea-8ab8-81584ddbb168 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:33.908985 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:33.910522 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:33.915488 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:33.916018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:33.924296 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:33.964437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:33.969753 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:33.981817 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1387/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:43.976041 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=6 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:44.963596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:44.964178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:45.056313 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760e9ae-f48e-470a-b39e-055b12ede5a7 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.062270 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.063148 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.063715 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.064182 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] PATH_INFO: `/v3/users/510f23f44f1d43818107af0e25de0ef3` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.067021 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510f23f44f1d43818107af0e25de0ef3)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.071087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.299198 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510f23f44f1d43818107af0e25de0ef3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.310005 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510f23f44f1d43818107af0e25de0ef3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.311231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510f23f44f1d43818107af0e25de0ef3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.311985 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510f23f44f1d43818107af0e25de0ef3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.326897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-2b45c72b-fbfd-44ae-8151-2c85f03c5d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510f23f44f1d43818107af0e25de0ef3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.431835 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1390/2777] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:44 2022] DELETE /identity/v3/users/510f23f44f1d43818107af0e25de0ef3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:45.706012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:45.721096 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6d5c9-7ec7-43c7-a57f-2a3f8982a26c service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:45.787159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:45.787805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:45.788118 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:45.788397 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] PATH_INFO: `/v3/projects/fd6789eda04e4dcf907469754bc2720b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:45.789571 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6789eda04e4dcf907469754bc2720b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:45.791477 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:45.903543 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6789eda04e4dcf907469754bc2720b', 'request_id': 'req-6750195e-829e-44ed-903c-28bd9975e573'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.911076 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6789eda04e4dcf907469754bc2720b', 'request_id': 'req-6750195e-829e-44ed-903c-28bd9975e573'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.987105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6789eda04e4dcf907469754bc2720b', 'request_id': 'req-6750195e-829e-44ed-903c-28bd9975e573'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:45.999960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] The token cache is being invalidate because project fd6789eda04e4dcf907469754bc2720b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:46.006996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:46.006996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6750195e-829e-44ed-903c-28bd9975e573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:46.006996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1388/2778] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:45 2022] DELETE /identity/v3/projects/fd6789eda04e4dcf907469754bc2720b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:46.009500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.010016 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.010252 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.042526 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:46.044822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:46.153204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1391/2779] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:46.162193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.162469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.162735 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.184935 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:46.186176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:46.195546 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1389/2780] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:46.200580 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.212348 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9944697-3d7c-46f3-9bf9-b48da109039a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.217294 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.218117 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.218398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.218675 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.219392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:28:46.219701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.221380 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.234732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1392/2781] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:28:46.239619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.249800 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7512a-306c-4e87-8187-dde9d5fa3a4e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.255653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.256318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.256599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.256895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.257589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.259539 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.371711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1390/2782] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:46 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:46.376500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.387600 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c122-f5ba-45f5-8118-8b7098ca8d2e admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.391688 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:46.466520 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.467140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.467418 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.467699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.468414 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.470484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.542158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1393/2783] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:46 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:28:46.546303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.557740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a6e5-0a19-4ce9-802a-074236a2825a admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.562688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.563323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.563602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.563871 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.564600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.566275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.577318 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1391/2784] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:46.581528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.596596 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f217e-e16b-4af2-8615-e4826b36f658 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.603321 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.604034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.604319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.604597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.605329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.607006 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ed5d1-e0f4-4abe-8f3c-140167a906bb admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.619130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1394/2785] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:46.623359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.633798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74cfe2-6871-40cb-ba3e-17edf28c5022 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.638782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.639443 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.639732 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.640049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] PATH_INFO: `/v3/projects/0ab27fdacfd542c7a20762c026357322/users/4f050b9dcb894fdcb52b3184c9670bf7/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.656169 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab27fdacfd542c7a20762c026357322, user_id=4f050b9dcb894fdcb52b3184c9670bf7, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.661274 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.730259 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1392/2786] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:46 2022] PUT /identity/v3/projects/0ab27fdacfd542c7a20762c026357322/users/4f050b9dcb894fdcb52b3184c9670bf7/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:46.741779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.742065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.742431 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.773144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] MFA Rules not processed for user `4f050b9dcb894fdcb52b3184c9670bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:46.774410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:46.842994 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1395/2787] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:46.855317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:46.857155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:46.885988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:46.940550 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eeab2-ce1c-4448-b447-fa7771e12ab6 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:46.947185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:46.954075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:46.954075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:46.954075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:46.956970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:46.958607 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef553f-6f9b-49d9-8ae1-7a69d3cd530e service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:46.969202 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1393/2788] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:50.216566 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:50.283166 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c44cb1-53d8-45b7-bfa6-3f7521dea761 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:50.288724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:50.289362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:50.289641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:50.289914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] PATH_INFO: `/v3/users/4f050b9dcb894fdcb52b3184c9670bf7` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:50.291081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f050b9dcb894fdcb52b3184c9670bf7)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:50.293055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:50.309995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:50.528643 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f050b9dcb894fdcb52b3184c9670bf7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:50.536762 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f050b9dcb894fdcb52b3184c9670bf7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:50.537641 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f050b9dcb894fdcb52b3184c9670bf7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:50.538259 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f050b9dcb894fdcb52b3184c9670bf7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:50.550915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f050b9dcb894fdcb52b3184c9670bf7'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:50.609858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1396/2789] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:50 2022] DELETE /identity/v3/users/4f050b9dcb894fdcb52b3184c9670bf7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:50.615837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:50.616581 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:50.616699 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:50.641082 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:50.642343 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:50.726015 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1394/2790] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:50.736963 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:50.739724 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:50.804924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96db3e-1e68-49dc-be21-329b5f8bde5d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:50.815406 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:50.816110 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:50.816392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:50.816666 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:50.826895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:50.828465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c2c24-e886-4417-9e08-1ad4adffce31 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:50.839342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1397/2791] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:51.270899 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:51.272599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:51.292941 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e805f-d06a-463b-b049-522422fb482c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:51.299334 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:51.299879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.300197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.300804 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] PATH_INFO: `/v3/projects/0ab27fdacfd542c7a20762c026357322` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.302020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab27fdacfd542c7a20762c026357322)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:51.303986 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:51.427934 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab27fdacfd542c7a20762c026357322', 'request_id': 'req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:51.434300 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab27fdacfd542c7a20762c026357322', 'request_id': 'req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:51.500473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab27fdacfd542c7a20762c026357322', 'request_id': 'req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:51.512075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] The token cache is being invalidate because project 0ab27fdacfd542c7a20762c026357322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:51.512361 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:51.512987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-496041d2-1f6c-4243-95d9-1d3f0b5bfc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:51.514533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1395/2792] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:51 2022] DELETE /identity/v3/projects/0ab27fdacfd542c7a20762c026357322 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:28:51.520430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.520948 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.521065 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.541393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:51.542991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:51.613650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1398/2793] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:51.622251 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.627116 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.627410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.649527 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:51.650752 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:51.658862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1396/2794] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:51.663456 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:51.674929 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c7e1-9476-468b-bb72-d0af73dfaf47 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:51.682884 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:51.683524 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.683791 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.684094 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.684795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:28:51.685100 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:51.686746 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:51.701203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1399/2795] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:28:51.705629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:51.715922 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f925-443e-4837-8c6f-cb44b61a8572 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:51.720713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:51.721328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.721611 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.721890 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.723357 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:51.725313 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:51.821754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:51.829383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1397/2796] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:51 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:51.835685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:51.852914 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07751-03c9-4772-a63a-3e4b426db54d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:51.874316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:51.912420 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:51.913376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:51.913740 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:51.914012 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:51.914673 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:51.916618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.039247 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1400/2797] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:51 2022] POST /identity/v3/users => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:52.043423 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.055110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29e9c-b400-4772-9d70-157d9ca1d2dd admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.060131 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.060786 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.061070 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.061347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.062073 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.063710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.074685 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1398/2798] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:52.078930 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.089968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e501d-eb03-4ea4-8f03-987f86b125b8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.094683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.095286 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.095570 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.095847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.096581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.098858 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d978bc-b101-4175-974a-c9fa80db34d1 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.108937 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1401/2799] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:52.113304 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.123309 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8c3c6-c1ae-484b-bcce-33431e8997ef admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.128174 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.129375 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.129653 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.129932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] PATH_INFO: `/v3/projects/02564bf592044f6a87174209d8cb3811/users/f8c5d46a1397467faac5ae859f405d04/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.146745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02564bf592044f6a87174209d8cb3811, user_id=f8c5d46a1397467faac5ae859f405d04, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.149492 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.244193 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1399/2800] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:52 2022] PUT /identity/v3/projects/02564bf592044f6a87174209d8cb3811/users/f8c5d46a1397467faac5ae859f405d04/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:52.256296 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.256659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.257036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.292597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] MFA Rules not processed for user `f8c5d46a1397467faac5ae859f405d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:52.293819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:52.366780 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1402/2801] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:52.376820 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.444806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab4fd-a9a7-4cfe-900e-2e838c188409 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.449793 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.450425 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.450693 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.450970 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.451637 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.453658 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.555353 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1400/2802] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:52 2022] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:52.559266 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.570659 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e601372-ba5d-437f-80db-03afcb661242 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.632199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.632819 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.633095 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.633368 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.634052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.636010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.742771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1403/2803] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:52 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:28:52.746710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.757938 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473872d-d919-4cc6-ac09-64e820d95fe8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.764705 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.765346 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.765630 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.765908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.766617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.768321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.780591 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1401/2804] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:52.786463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.797325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbb663-4bd6-4ce6-8cf1-12710a67a398 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.802225 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.802916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.803199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.803480 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] PATH_INFO: `/v3/projects/1d5640351b704afd9100a05d65dc7df4/users/1936c302f4614a0783ed2acdaa50fe7e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.820352 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5640351b704afd9100a05d65dc7df4, user_id=1936c302f4614a0783ed2acdaa50fe7e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.823378 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.895873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:52.902642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1404/2805] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:52 2022] PUT /identity/v3/projects/1d5640351b704afd9100a05d65dc7df4/users/1936c302f4614a0783ed2acdaa50fe7e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:28:52.906702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:52.917895 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89f9c-7ad9-4a18-9025-1a429ff46ba4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:52.975197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:52.975840 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:52.976141 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:52.976410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:52.977098 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:52.978701 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff4530-abed-4a45-b39a-6d21b0af2278 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:52.989602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1402/2806] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:52.993783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:53.004565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5996-cfc6-46f6-88a3-b2d1e0688372 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:53.009457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:53.012325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.012325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.012325 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] PATH_INFO: `/v3/projects/1d5640351b704afd9100a05d65dc7df4/users/1936c302f4614a0783ed2acdaa50fe7e/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.012949 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5640351b704afd9100a05d65dc7df4, user_id=1936c302f4614a0783ed2acdaa50fe7e, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:53.015582 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:53.026009 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1405/2807] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:52 2022] PUT /identity/v3/projects/1d5640351b704afd9100a05d65dc7df4/users/1936c302f4614a0783ed2acdaa50fe7e/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:53.038549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.038838 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.046379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.070288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] MFA Rules not processed for user `1936c302f4614a0783ed2acdaa50fe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:53.071602 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:53.095071 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:53.152465 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1403/2808] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:53.164155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:53.165925 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:53.230674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cbc2e-7887-47e6-baf5-1384ac091843 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:53.234663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:53.235339 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.235616 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.235888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.246618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:53.248083 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a691b-eb0c-4753-8838-f2de9f17a535 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:53.259463 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1406/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:53.414516 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:53.486393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4af804-528f-4df6-92d6-4523e46349b4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:53.491487 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:53.492161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.492446 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.492722 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] PATH_INFO: `/v3/users/f8c5d46a1397467faac5ae859f405d04` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.493901 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c5d46a1397467faac5ae859f405d04)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:53.495956 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:53.668815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c5d46a1397467faac5ae859f405d04'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:53.675785 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c5d46a1397467faac5ae859f405d04'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:53.676499 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c5d46a1397467faac5ae859f405d04'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:53.693245 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c5d46a1397467faac5ae859f405d04'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:53.746518 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c5d46a1397467faac5ae859f405d04'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:53.753059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1404/2810] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:53 2022] DELETE /identity/v3/users/f8c5d46a1397467faac5ae859f405d04 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:53.758061 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b423c-592e-484c-ba61-56957264261a None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.758798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b423c-592e-484c-ba61-56957264261a None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.758798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b423c-592e-484c-ba61-56957264261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.780500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-069b423c-592e-484c-ba61-56957264261a None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:53.781795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-069b423c-592e-484c-ba61-56957264261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:53.848540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1407/2811] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:53.858677 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:53.860278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:53.911223 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:53.929954 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e8354-8ade-4f18-b7a9-4d7d8423b7e1 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:53.933784 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:53.934410 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:53.934691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:53.934966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:53.945284 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:53.946798 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:53.957433 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1405/2812] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:54.435085 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b423c-592e-484c-ba61-56957264261a None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:54.436638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-069b423c-592e-484c-ba61-56957264261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:54.452310 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b423c-592e-484c-ba61-56957264261a None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:54.458423 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:54.459132 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:54.459464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:54.459742 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] PATH_INFO: `/v3/projects/02564bf592044f6a87174209d8cb3811` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:54.461156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] RBAC: Authorizing `identity:delete_project(project_id=02564bf592044f6a87174209d8cb3811)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:54.463366 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:54.575654 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02564bf592044f6a87174209d8cb3811', 'request_id': 'req-17f8e500-21b2-49d9-98c2-f3fbbbf955da'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.582272 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02564bf592044f6a87174209d8cb3811', 'request_id': 'req-17f8e500-21b2-49d9-98c2-f3fbbbf955da'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.655114 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02564bf592044f6a87174209d8cb3811', 'request_id': 'req-17f8e500-21b2-49d9-98c2-f3fbbbf955da'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.667138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] The token cache is being invalidate because project 02564bf592044f6a87174209d8cb3811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:54.667426 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.668105 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.669613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1408/2813] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:54 2022] DELETE /identity/v3/projects/02564bf592044f6a87174209d8cb3811 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:54.673617 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:54.684881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b86c1-e56b-46a5-a24f-54c3e94e74ee service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:54.743039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:54.743682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:54.743994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:54.744264 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] PATH_INFO: `/v3/users/1936c302f4614a0783ed2acdaa50fe7e` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:54.745434 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1936c302f4614a0783ed2acdaa50fe7e)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:54.747373 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:54.955323 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1936c302f4614a0783ed2acdaa50fe7e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.964212 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1936c302f4614a0783ed2acdaa50fe7e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.964957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1936c302f4614a0783ed2acdaa50fe7e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:54.978417 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1936c302f4614a0783ed2acdaa50fe7e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.083783 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-49a6b0ff-1b27-4384-a8b3-bca76127517d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1936c302f4614a0783ed2acdaa50fe7e'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.090592 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1406/2814] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:28:54 2022] DELETE /identity/v3/users/1936c302f4614a0783ed2acdaa50fe7e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:28:55.576868 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:55.578357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:55.608626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8e500-21b2-49d9-98c2-f3fbbbf955da admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:55.608626 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:55.657202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:55.657856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:55.658140 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:55.658417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] PATH_INFO: `/v3/projects/1d5640351b704afd9100a05d65dc7df4` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:55.660539 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5640351b704afd9100a05d65dc7df4)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:55.662309 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:55.770415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5640351b704afd9100a05d65dc7df4', 'request_id': 'req-34ef7e3f-33ff-4573-82eb-260eb045e307'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.778177 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5640351b704afd9100a05d65dc7df4', 'request_id': 'req-34ef7e3f-33ff-4573-82eb-260eb045e307'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.860577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5640351b704afd9100a05d65dc7df4', 'request_id': 'req-34ef7e3f-33ff-4573-82eb-260eb045e307'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.872787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] The token cache is being invalidate because project 1d5640351b704afd9100a05d65dc7df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:28:55.877136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.877136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-34ef7e3f-33ff-4573-82eb-260eb045e307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:28:55.877136 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1409/2815] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:28:55 2022] DELETE /identity/v3/projects/1d5640351b704afd9100a05d65dc7df4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:55.881214 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:55.881500 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:55.881782 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:55.903105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:55.904440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:55.961075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:55.972140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1407/2816] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:55.979312 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:55.979638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:55.979872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.001716 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:56.002955 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:56.012455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1410/2817] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:28:56.016869 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.027897 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcd622-4e9f-415e-9154-b562d0c92adf None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.032757 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.033382 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.033663 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.033936 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.034631 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:28:56.034939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.036754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.049566 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1408/2818] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:28:56.054795 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.064726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3e51-552e-49c1-95c5-17dbc1ad8180 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.069988 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.070611 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.070897 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.071179 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.071854 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.073796 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.171153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1411/2819] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:56 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 05:28:56.175340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.188586 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb764c5-35e3-4cc2-a3ed-04a8985a88b8 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.248910 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.249530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.249816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.250095 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.250761 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.252740 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.358008 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1409/2820] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:56 2022] POST /identity/v3/users => generated 279 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:56.362474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.374135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847a2fc-0c17-423b-9bbb-7c8cab3aa699 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.378944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.379605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.380501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.380778 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.381501 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.383138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.396743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1412/2821] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:28:56.400805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.412496 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609aa7-2794-4001-b4a1-dbdcd7dd1f09 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.417258 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.417881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.418157 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.418426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.419128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.420861 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129d72-2f00-4bcf-bb97-ded876952e81 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.433594 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1410/2822] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:28:56.437818 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.450231 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5bade-3742-4d79-abb9-d2c2b2129f27 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.455034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.455702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.456008 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.456282 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] PATH_INFO: `/v3/projects/6f4d3738eb444e79929d406ad4bc6478/users/eb15ec8254004ffbb7e152a280d061b6/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.477332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4d3738eb444e79929d406ad4bc6478, user_id=eb15ec8254004ffbb7e152a280d061b6, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.481071 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.572168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1413/2823] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:56 2022] PUT /identity/v3/projects/6f4d3738eb444e79929d406ad4bc6478/users/eb15ec8254004ffbb7e152a280d061b6/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:28:56.590412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.590926 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.591429 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.628760 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] MFA Rules not processed for user `eb15ec8254004ffbb7e152a280d061b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:56.630037 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:56.698106 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1411/2824] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:56.706944 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.749883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:56.772987 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0fea-d4ad-4048-9216-be88ea23f4e0 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.777718 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.778332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.778624 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.779112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.779829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.782410 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:56.869683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1414/2825] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:28:56 2022] POST /identity/v3/projects => generated 357 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:56.873844 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:56.885275 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3db2-258a-4ec6-9cd8-de05a776b32c None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:56.938282 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:56.945835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:56.946524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:56.950370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:56.950370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:56.950370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:56.950370 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.020847 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1412/2826] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:28:56 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:28:57.024888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.035649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673834-43fe-4f55-9e92-fe5b169e449b admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.041147 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.041802 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.042112 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.042413 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.043180 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.044924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.057504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1415/2827] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:57.061875 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.072955 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2e91-88f0-4cf9-bb8d-62ff6d8fc7cf admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.078723 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.079405 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.079684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.079991 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] PATH_INFO: `/v3/projects/833d4ebcbd5a49b88a811d877de31dd0/users/561094ce8a294f7dab49053b6759d705/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.095972 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833d4ebcbd5a49b88a811d877de31dd0, user_id=561094ce8a294f7dab49053b6759d705, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.099413 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.164121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1413/2828] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:57 2022] PUT /identity/v3/projects/833d4ebcbd5a49b88a811d877de31dd0/users/561094ce8a294f7dab49053b6759d705/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:57.168128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.179253 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43954-90de-43e0-ba25-894340ee840c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.237316 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.237856 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.238138 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.238417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.239647 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.241430 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e945d-0fab-4366-b568-3949a88e6b6b admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.251318 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1416/2829] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:28:57.256147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.266657 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab189d-a38a-4ce0-b976-af21721ac941 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.271332 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.272046 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.272321 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.272589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] PATH_INFO: `/v3/projects/833d4ebcbd5a49b88a811d877de31dd0/users/561094ce8a294f7dab49053b6759d705/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.274559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833d4ebcbd5a49b88a811d877de31dd0, user_id=561094ce8a294f7dab49053b6759d705, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.277317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.289674 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1414/2830] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:28:57 2022] PUT /identity/v3/projects/833d4ebcbd5a49b88a811d877de31dd0/users/561094ce8a294f7dab49053b6759d705/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:28:57.354518 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.354798 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.355064 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.383978 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] MFA Rules not processed for user `561094ce8a294f7dab49053b6759d705`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:28:57.385204 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:57.454499 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1417/2831] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:28:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:28:57.465650 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.467416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:28:57.528155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfb5b-5f5d-41d3-a12a-a27429a07b41 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.531806 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.532460 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.532747 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.533017 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.543026 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.544509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.554771 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1415/2832] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:28:57.750424 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:28:57.761405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf8ba-5181-4100-b3b1-cf1e08ae57e3 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:28:57.765073 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:28:57.765815 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:28:57.765962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:28:57.766258 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:28:57.800648 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:28:57.829872 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:28:57.831784 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff2b8-3054-4c9b-a064-f463e84f901d service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:28:57.842583 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1418/2833] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:28:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:07.549816 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:07.866618 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=13 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:15.630664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:15.703327 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228c81-4296-4f83-aaf3-69fb6ff59a90 service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:15.708024 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:15.711061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:15.711061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:15.711061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] PATH_INFO: `/v3/users/eb15ec8254004ffbb7e152a280d061b6` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:15.711061 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb15ec8254004ffbb7e152a280d061b6)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:15.712530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:15.902253 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb15ec8254004ffbb7e152a280d061b6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:15.909241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb15ec8254004ffbb7e152a280d061b6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:15.909966 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb15ec8254004ffbb7e152a280d061b6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:15.921939 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb15ec8254004ffbb7e152a280d061b6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.003077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb15ec8254004ffbb7e152a280d061b6'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.010945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1416/2834] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:15 2022] DELETE /identity/v3/users/eb15ec8254004ffbb7e152a280d061b6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:16.015733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:16.016280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:16.016388 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:16.037317 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:16.038638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:16.108157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1419/2835] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:16.120664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:16.122385 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:16.186669 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602a0e-d21e-4a22-a0a6-e573c33d3dcb admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:16.190469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:16.191105 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:16.191386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:16.191660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:16.202052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:16.203512 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:16.214160 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1417/2836] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:16.674126 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:16.675808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:16.689829 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277dd3d-2ae5-4767-b8e2-f95673353d91 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:16.700261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:16.700261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:16.700261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:16.700261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] PATH_INFO: `/v3/projects/6f4d3738eb444e79929d406ad4bc6478` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:16.700838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4d3738eb444e79929d406ad4bc6478)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:16.700838 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:16.818774 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4d3738eb444e79929d406ad4bc6478', 'request_id': 'req-fa8cdc91-2ccd-4fef-a270-873d92c88413'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.827139 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4d3738eb444e79929d406ad4bc6478', 'request_id': 'req-fa8cdc91-2ccd-4fef-a270-873d92c88413'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.923053 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4d3738eb444e79929d406ad4bc6478', 'request_id': 'req-fa8cdc91-2ccd-4fef-a270-873d92c88413'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.935752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] The token cache is being invalidate because project 6f4d3738eb444e79929d406ad4bc6478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:16.937879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.937879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:16.938329 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1420/2837] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:16 2022] DELETE /identity/v3/projects/6f4d3738eb444e79929d406ad4bc6478 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:16.942393 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:16.953596 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aab11-9335-4d0e-80c7-cf397a336657 service neutron] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:16.984864 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:17.028333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:17.028979 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:17.029257 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:17.029530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] PATH_INFO: `/v3/users/561094ce8a294f7dab49053b6759d705` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:17.030750 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561094ce8a294f7dab49053b6759d705)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:17.032697 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:17.251831 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561094ce8a294f7dab49053b6759d705'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.259688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561094ce8a294f7dab49053b6759d705'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.260426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561094ce8a294f7dab49053b6759d705'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.272754 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561094ce8a294f7dab49053b6759d705'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.357111 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-181833d7-7e02-4a97-b9cb-4ac41a646931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561094ce8a294f7dab49053b6759d705'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:17.363656 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1418/2838] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:16 2022] DELETE /identity/v3/users/561094ce8a294f7dab49053b6759d705 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:17.810950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:17.812732 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:17.828360 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cdc91-2ccd-4fef-a270-873d92c88413 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:17.894934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:17.895565 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:17.895845 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:17.896153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] PATH_INFO: `/v3/projects/833d4ebcbd5a49b88a811d877de31dd0` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:17.897335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833d4ebcbd5a49b88a811d877de31dd0)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:17.899810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:17.998638 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:18.015242 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833d4ebcbd5a49b88a811d877de31dd0', 'request_id': 'req-37faf6db-a034-488e-a304-56a43c2fb4b0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.021447 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833d4ebcbd5a49b88a811d877de31dd0', 'request_id': 'req-37faf6db-a034-488e-a304-56a43c2fb4b0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.105915 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833d4ebcbd5a49b88a811d877de31dd0', 'request_id': 'req-37faf6db-a034-488e-a304-56a43c2fb4b0'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.117025 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] The token cache is being invalidate because project 833d4ebcbd5a49b88a811d877de31dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:18.117308 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.118024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-37faf6db-a034-488e-a304-56a43c2fb4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:18.119642 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1421/2839] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:17 2022] DELETE /identity/v3/projects/833d4ebcbd5a49b88a811d877de31dd0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:18.125742 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.126254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.126254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.148049 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:18.148208 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:18.209454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1419/2840] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:18.218155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.224037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.224037 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.239970 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:18.241203 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:18.249514 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1422/2841] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:18.258328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.264815 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9207a5-611a-44f2-a176-af3a1af5824e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.269490 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.270137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.270411 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.270687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] PATH_INFO: `/v3/domains` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.271383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:29:18.271680 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.273335 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.293684 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1420/2842] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 05:29:18.298605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.308621 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6bcb7-5213-4d37-b088-d75f90b57ad3 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.313469 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.314087 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.314370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.314645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.315429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.317362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.416968 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1423/2843] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:18.420664 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.431230 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f639-763a-4730-bf8d-1d4223fc773e admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.458065 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:18.488646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.489269 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.489553 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.489830 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.490509 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.492661 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.592687 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1421/2844] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:18.597159 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.608537 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e8ec-437b-44ec-8ad5-523ed3b2d1ae admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.613738 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.614395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.614812 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.615092 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.615810 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.617488 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.629382 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1424/2845] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:29:18.634702 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.645486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c3c4-43c9-4d0e-b7d7-dfd4ec42297b admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.650567 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.651197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.651473 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.651746 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.652523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.654139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f4e3-8085-42c8-9f13-83bc431422e0 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.666060 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1422/2846] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:18.670652 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.681663 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9005c-12ff-445c-aac4-aefd4f97b2b6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.686335 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.686995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.687276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.687549 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] PATH_INFO: `/v3/projects/08518c32781d49e4b3fb1cdad593e5ca/users/278d2f23bd9042bdaf87ce4b4c8199f5/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.712587 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08518c32781d49e4b3fb1cdad593e5ca, user_id=278d2f23bd9042bdaf87ce4b4c8199f5, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.715398 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:18.770823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1425/2847] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:18 2022] PUT /identity/v3/projects/08518c32781d49e4b3fb1cdad593e5ca/users/278d2f23bd9042bdaf87ce4b4c8199f5/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:18.788185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.788471 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.798691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.820137 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] MFA Rules not processed for user `278d2f23bd9042bdaf87ce4b4c8199f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:18.822179 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:18.889676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1423/2848] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:18.894487 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:18.964656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cf312-fe5b-4b28-a5df-747e421a5433 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:18.966457 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:18.967135 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:18.967412 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:18.967682 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:18.968474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:18.970376 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.039127 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1426/2849] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:18 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:19.043458 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.059128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e7b92-9d42-497e-b5e9-e64d6f821d2d None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.136599 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.137328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.137533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.137906 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.138622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.140622 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.228140 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1424/2850] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:19 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:19.232894 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.244332 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971492-12c6-40f1-8884-4330c12ec9a7 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.249319 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.251484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.251484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.251484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.251484 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.252846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.265070 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1427/2851] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:29:19.269426 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.280715 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147fa2d-64f6-440c-953b-840c8d388ce9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.285421 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.286090 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.286367 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.286642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] PATH_INFO: `/v3/projects/60e453d343d64cec98ef6b483d8d831b/users/2fab85f51210465bb0b4da166fcc4af5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.302197 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e453d343d64cec98ef6b483d8d831b, user_id=2fab85f51210465bb0b4da166fcc4af5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.304996 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.380601 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1425/2852] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:19 2022] PUT /identity/v3/projects/60e453d343d64cec98ef6b483d8d831b/users/2fab85f51210465bb0b4da166fcc4af5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:19.386256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.397178 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcfec8-e28b-4384-a05e-87639b431312 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.418056 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:19.455538 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.456195 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.456475 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.456751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.457443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.459142 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdede2a-a808-4d9e-9d8c-61b4a93e4260 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.469879 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1428/2853] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:29:19.474881 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.479741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:19.485272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1568b1-8788-432a-b41f-34e26fe9a583 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.490440 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.491119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.491403 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.491683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] PATH_INFO: `/v3/projects/60e453d343d64cec98ef6b483d8d831b/users/2fab85f51210465bb0b4da166fcc4af5/roles/5a02b24f89c148f78d88275904494739` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.495129 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e453d343d64cec98ef6b483d8d831b, user_id=2fab85f51210465bb0b4da166fcc4af5, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.497860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.511340 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1426/2854] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:19 2022] PUT /identity/v3/projects/60e453d343d64cec98ef6b483d8d831b/users/2fab85f51210465bb0b4da166fcc4af5/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:19.522458 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.522728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.523002 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.553697 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] MFA Rules not processed for user `2fab85f51210465bb0b4da166fcc4af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:19.554934 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:19.628336 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1429/2855] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:19.640247 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.642075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:19.702618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdfdeb-9c79-4ea1-813e-d8d8001804fe admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.706648 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.707348 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.707636 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.707927 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.718119 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.719867 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e738-a427-426a-8699-980b30f332d7 service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:19.731860 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1427/2856] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:19.883683 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:19.954171 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abc835-0835-4720-93d7-49e089f6ca5b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:19.958766 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:19.959404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:19.959685 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:19.959982 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] PATH_INFO: `/v3/users/278d2f23bd9042bdaf87ce4b4c8199f5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:19.961153 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278d2f23bd9042bdaf87ce4b4c8199f5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:19.963120 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:20.194276 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278d2f23bd9042bdaf87ce4b4c8199f5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:20.195545 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:20.202721 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278d2f23bd9042bdaf87ce4b4c8199f5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:20.203534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278d2f23bd9042bdaf87ce4b4c8199f5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:20.204199 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278d2f23bd9042bdaf87ce4b4c8199f5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:20.217168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278d2f23bd9042bdaf87ce4b4c8199f5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:20.300907 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1430/2857] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:19 2022] DELETE /identity/v3/users/278d2f23bd9042bdaf87ce4b4c8199f5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:20.306695 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:20.307235 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:20.307584 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:20.329469 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:20.330713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:20.398819 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1428/2858] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:20.409101 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:20.410653 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:20.478606 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6cc0a-d19b-4e32-a922-cc3314b75334 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:20.482279 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:20.482908 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:20.483184 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:20.483455 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:20.494015 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:20.495522 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:20.505726 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1431/2859] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:29:20.993928 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:20.995404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:21.008359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cabec2-9525-41d5-8ba9-9fbfe4afaace None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:21.014356 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:21.015031 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:21.015338 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:21.015619 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] PATH_INFO: `/v3/projects/08518c32781d49e4b3fb1cdad593e5ca` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:21.016835 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08518c32781d49e4b3fb1cdad593e5ca)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:21.019153 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:21.152679 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08518c32781d49e4b3fb1cdad593e5ca', 'request_id': 'req-3205da15-27bd-40e2-8ee9-8e0aa7e53755'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.159151 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08518c32781d49e4b3fb1cdad593e5ca', 'request_id': 'req-3205da15-27bd-40e2-8ee9-8e0aa7e53755'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.243089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08518c32781d49e4b3fb1cdad593e5ca', 'request_id': 'req-3205da15-27bd-40e2-8ee9-8e0aa7e53755'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.255074 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] The token cache is being invalidate because project 08518c32781d49e4b3fb1cdad593e5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:21.256286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.256286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.257857 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1429/2860] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:20 2022] DELETE /identity/v3/projects/08518c32781d49e4b3fb1cdad593e5ca => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:21.262528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:21.276482 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106c150-e82e-4716-b8d5-24da143fdaa9 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:21.342157 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:21.342813 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:21.343097 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:21.343374 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] PATH_INFO: `/v3/users/2fab85f51210465bb0b4da166fcc4af5` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:21.344699 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fab85f51210465bb0b4da166fcc4af5)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:21.346650 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:21.545581 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fab85f51210465bb0b4da166fcc4af5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.553365 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fab85f51210465bb0b4da166fcc4af5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.554125 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fab85f51210465bb0b4da166fcc4af5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.559370 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fab85f51210465bb0b4da166fcc4af5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.566589 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:21.569249 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-1e1043af-e40d-4474-88be-9870c7463023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fab85f51210465bb0b4da166fcc4af5'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:21.643748 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1432/2861] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:21 2022] DELETE /identity/v3/users/2fab85f51210465bb0b4da166fcc4af5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:29:22.130229 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.132963 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:22.151279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205da15-27bd-40e2-8ee9-8e0aa7e53755 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.169957 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:22.223710 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.224444 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.224755 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.225034 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] PATH_INFO: `/v3/projects/60e453d343d64cec98ef6b483d8d831b` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.226303 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e453d343d64cec98ef6b483d8d831b)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.229012 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.337506 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e453d343d64cec98ef6b483d8d831b', 'request_id': 'req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:22.344688 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e453d343d64cec98ef6b483d8d831b', 'request_id': 'req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:22.386528 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e453d343d64cec98ef6b483d8d831b', 'request_id': 'req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:22.398756 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] The token cache is being invalidate because project 60e453d343d64cec98ef6b483d8d831b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:22.399628 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:22.400670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-82fc30a9-8a3c-4ab5-adc1-5a3497e6b837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:22.402278 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1430/2862] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:22 2022] DELETE /identity/v3/projects/60e453d343d64cec98ef6b483d8d831b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:22.407605 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.408183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.408183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.429404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:22.430672 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:22.494269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1433/2863] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:22.502445 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.502862 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.503139 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.525162 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:22.526678 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:22.534914 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1431/2864] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:22.539392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.559678 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1727-fe85-43a0-803f-7e703eddcc8b None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.562999 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.563628 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.563922 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.564202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.564906 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:29:22.565205 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.566808 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.580036 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1434/2865] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:29:22.584690 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.595018 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceaa55-1506-4748-b0c1-fc36e0c60913 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.599885 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.600530 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.600822 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.601093 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.601767 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.604609 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.695945 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1432/2866] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:22 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:22.701500 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.713867 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a930-2ebf-427b-a766-7814831ae4b8 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.795749 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.796417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.796702 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.796981 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.797656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.799617 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.877711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1435/2867] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:22 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:22.882167 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.894028 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78151-e85b-48c0-bd4b-13fcadd3bae9 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.900134 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.900777 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.901052 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.901326 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.902033 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.903763 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.914792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1433/2868] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:22.920477 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.931150 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fab4d-58db-4340-9d4a-623611f5154d admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.936232 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.936870 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.937155 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.937437 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.938145 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:22.939770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff406d-a385-4d2f-a10a-85cb5e83b086 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:22.953261 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1436/2869] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:22.964344 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:22.974904 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c414-ebb1-4b67-a42b-5bee306ebb5f admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:22.980196 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:22.980879 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:22.981155 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:22.981428 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] PATH_INFO: `/v3/projects/5999893460684e0e9c06e3468d7d09b9/users/07c7092db1d24c52836b74133daa5a9a/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:22.997505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5999893460684e0e9c06e3468d7d09b9, user_id=07c7092db1d24c52836b74133daa5a9a, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.000306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.117198 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1434/2870] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:22 2022] PUT /identity/v3/projects/5999893460684e0e9c06e3468d7d09b9/users/07c7092db1d24c52836b74133daa5a9a/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:23.129491 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.129779 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.130055 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.161832 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] MFA Rules not processed for user `07c7092db1d24c52836b74133daa5a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:23.163344 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:23.208739 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:23.232024 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1437/2871] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:29:23.236668 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.287188 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:23.306231 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093743f-c349-485e-9fbf-ea55f54e96b4 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.311035 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.314974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.314974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.314974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.314974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.314974 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.399720 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1435/2872] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:23 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:23.404081 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.415645 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1458-f1a1-4f4e-90ec-83d81bce6fea None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.472964 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.473490 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.473771 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.474044 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.474705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.476649 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.581576 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1438/2873] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:23 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:23.586211 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.598559 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4151a4-8093-4845-b122-aa284226804d admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.603660 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.604351 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.604634 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.604908 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.605625 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.607283 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.619077 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1436/2874] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 05:29:23.623705 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.635141 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e35d-3933-48d6-9a59-310028604029 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.640395 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.644575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.644575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.644575 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] PATH_INFO: `/v3/projects/73e6677a69c84c0c8fff66667ea43a33/users/82230af975834b468686d52fc4b893a3/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.658392 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e6677a69c84c0c8fff66667ea43a33, user_id=82230af975834b468686d52fc4b893a3, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.661134 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.734706 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1439/2875] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:23 2022] PUT /identity/v3/projects/73e6677a69c84c0c8fff66667ea43a33/users/82230af975834b468686d52fc4b893a3/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:23.739255 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.750734 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd431a-928d-4b6b-bc47-6302f16db635 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.814272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.814907 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.815192 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.815470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.816206 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.817998 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39942a-3959-4f22-bdf6-d166e2d9e76e admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.828980 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1437/2876] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:23.833916 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:23.850656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2a1e3-a2f4-4363-9e22-7bb777ed2db6 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:23.855956 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:23.856656 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.856940 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.857214 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] PATH_INFO: `/v3/projects/73e6677a69c84c0c8fff66667ea43a33/users/82230af975834b468686d52fc4b893a3/roles/5a02b24f89c148f78d88275904494739` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.859770 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e6677a69c84c0c8fff66667ea43a33, user_id=82230af975834b468686d52fc4b893a3, role_id=5a02b24f89c148f78d88275904494739)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:23.862465 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:23.875269 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1440/2877] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:23 2022] PUT /identity/v3/projects/73e6677a69c84c0c8fff66667ea43a33/users/82230af975834b468686d52fc4b893a3/roles/5a02b24f89c148f78d88275904494739 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:23.887013 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:23.887331 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:23.887620 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:23.918821 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] MFA Rules not processed for user `82230af975834b468686d52fc4b893a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:23.920110 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:24.000810 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1438/2878] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 05:29:24.014556 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:24.016306 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:24.082068 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ecf86-35c8-4cd9-a359-606d1f287d30 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:24.086003 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:24.086783 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:24.087256 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:24.087597 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:24.099422 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:24.100911 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:24.112750 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1441/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:24.258163 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:24.268834 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264524d-bdac-422e-9f62-1d9d22d9976e None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:24.272424 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:24.273036 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:24.273317 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:24.273589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:24.314422 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:24.338449 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:24.340412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fafded-4bba-4383-9b32-c63c554065ae service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:24.350371 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1439/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:24.841130 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:24.884966 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:24.907301 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3abc0-34f4-4a06-86a8-ef0bcc017412 service cinder] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:24.911962 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:24.912603 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:24.912888 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:24.913163 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] PATH_INFO: `/v3/users/07c7092db1d24c52836b74133daa5a9a` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:24.914340 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c7092db1d24c52836b74133daa5a9a)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:24.917128 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:25.098599 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c7092db1d24c52836b74133daa5a9a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:25.106661 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c7092db1d24c52836b74133daa5a9a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:25.107379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c7092db1d24c52836b74133daa5a9a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:25.108019 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c7092db1d24c52836b74133daa5a9a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:25.120494 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c7092db1d24c52836b74133daa5a9a'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:25.231183 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1442/2881] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:24 2022] DELETE /identity/v3/users/07c7092db1d24c52836b74133daa5a9a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 05:29:25.235805 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:25.236128 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:25.236406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:25.255703 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:25.256960 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:25.328942 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1440/2882] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:25.340257 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:25.341630 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:25.404823 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6041-9bf0-4d08-bf18-55dfad8a9224 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:25.408563 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:25.409162 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:25.409443 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:25.409728 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:25.420901 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:25.422379 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:25.433342 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1443/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:25.902845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:25.905406 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:25.917737 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a3fd-a5ac-42c9-891a-aab7ef25b9a4 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:25.922383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:25.923053 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:25.923310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:25.923583 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] PATH_INFO: `/v3/projects/5999893460684e0e9c06e3468d7d09b9` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:25.924808 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5999893460684e0e9c06e3468d7d09b9)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:25.932104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:26.045020 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5999893460684e0e9c06e3468d7d09b9', 'request_id': 'req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.052891 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5999893460684e0e9c06e3468d7d09b9', 'request_id': 'req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.214293 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5999893460684e0e9c06e3468d7d09b9', 'request_id': 'req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.232971 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] The token cache is being invalidate because project 5999893460684e0e9c06e3468d7d09b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:26.233260 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.233976 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.235728 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1441/2884] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:25 2022] DELETE /identity/v3/projects/5999893460684e0e9c06e3468d7d09b9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:26.239877 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:26.256822 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0e683-6fb8-4d47-b56d-3280f3ca2e3b service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:26.350359 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:26.351144 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:26.351429 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:26.351714 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] PATH_INFO: `/v3/users/82230af975834b468686d52fc4b893a3` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:26.353202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82230af975834b468686d52fc4b893a3)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:26.355156 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:26.357202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:26.609503 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82230af975834b468686d52fc4b893a3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.617504 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82230af975834b468686d52fc4b893a3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.618931 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82230af975834b468686d52fc4b893a3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.619607 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82230af975834b468686d52fc4b893a3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.633864 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-f98af4c6-4019-4072-bed8-9be96aab99f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82230af975834b468686d52fc4b893a3'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:26.768896 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1444/2885] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:26 2022] DELETE /identity/v3/users/82230af975834b468686d52fc4b893a3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:27.342454 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:27.342943 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:27.358306 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c51c2a-d7b3-48eb-8e71-c05b0cd04f00 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:27.421603 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:27.422256 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:27.422529 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:27.422799 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] PATH_INFO: `/v3/projects/73e6677a69c84c0c8fff66667ea43a33` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:27.424014 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e6677a69c84c0c8fff66667ea43a33)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:27.425933 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:27.427629 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:27.545988 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e6677a69c84c0c8fff66667ea43a33', 'request_id': 'req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:27.552298 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e6677a69c84c0c8fff66667ea43a33', 'request_id': 'req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:27.642416 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e6677a69c84c0c8fff66667ea43a33', 'request_id': 'req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:27.654075 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] The token cache is being invalidate because project 73e6677a69c84c0c8fff66667ea43a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:29:27.654364 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:27.655039 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-993bc4fe-f6b0-49f6-9c7b-9ede5bae0d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:27.656994 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1442/2886] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:29:27 2022] DELETE /identity/v3/projects/73e6677a69c84c0c8fff66667ea43a33 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:27.662207 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:27.662743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:27.662743 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:27.683786 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:27.685090 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:27.753052 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1445/2887] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:27.763333 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:27.763745 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:27.764159 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:27.784161 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:27.785394 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:27.793430 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1443/2888] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:27.797924 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:27.808942 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4b1e2-4af5-41ed-b8f8-6d590ecba903 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:27.813669 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:27.814287 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:27.814567 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:27.814843 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:27.815540 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 05:29:27.815847 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:27.817502 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:27.830300 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1446/2889] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Aug 4 05:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 05:29:27.834600 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:27.844383 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda005-6ce1-4dea-9dfe-5952e014b2d5 None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:27.849239 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:27.849865 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:27.850147 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:27.850420 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:27.851089 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:27.853100 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:27.987758 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1444/2890] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Aug 4 05:29:27 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:27.992124 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:28.003330 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db7f-c9e1-4311-a7be-e43ffca01d4c admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:28.063751 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:28.064401 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.064684 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.064960 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.065633 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:28.067562 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:28.078920 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:28.198588 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1447/2891] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Aug 4 05:29:27 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 05:29:28.202977 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:28.214641 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba547405-e1cb-44bf-9928-958f74f9aad5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:28.219741 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:28.220404 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.220711 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.220987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.221683 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:28.223286 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:28.234624 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1445/2892] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:28.239234 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:28.251530 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d28-2d07-42ae-9f17-06b4c182fff5 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:28.256839 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:28.257474 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.257759 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.258038 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.258752 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:28.260873 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c85709-35cd-4bb6-84dc-6a2552b90e98 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:28.272235 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1448/2893] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Aug 4 05:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 05:29:28.277837 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:28.287470 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949969-7c03-4631-ac67-d3830e071da5 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:28.292727 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:28.293398 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.293681 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.293958 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] PATH_INFO: `/v3/projects/5da21133e47f49ce997a7d8cb6aa4f0c/users/19f5b8b74dd84d6d93d8afa120bca9df/roles/9415c525f6a9419fa101c978fd4ef2de` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.309704 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da21133e47f49ce997a7d8cb6aa4f0c, user_id=19f5b8b74dd84d6d93d8afa120bca9df, role_id=9415c525f6a9419fa101c978fd4ef2de)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:28.312437 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:28.391714 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1446/2894] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Aug 4 05:29:28 2022] PUT /identity/v3/projects/5da21133e47f49ce997a7d8cb6aa4f0c/users/19f5b8b74dd84d6d93d8afa120bca9df/roles/9415c525f6a9419fa101c978fd4ef2de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:28.402945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b82b3-dded-4db9-a782-34ec4f4f7506 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.404051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b82b3-dded-4db9-a782-34ec4f4f7506 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.404051 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b82b3-dded-4db9-a782-34ec4f4f7506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.432149 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-8a4b82b3-dded-4db9-a782-34ec4f4f7506 None None] MFA Rules not processed for user `19f5b8b74dd84d6d93d8afa120bca9df`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:28.433394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-8a4b82b3-dded-4db9-a782-34ec4f4f7506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:28.500122 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1449/2895] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:28.511386 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:28.513176 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:28.573305 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea36df-3138-4152-a2ae-532a538c9605 admin admin] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:28.576932 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435f7709c1e4a59881b02d58d8c8463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:28.577549 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:28.577832 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:28.578103 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:28.586959 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:28.588498 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:28.597682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1447/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:30.555764 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:30.556991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:30.556991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:30.575850 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] MFA Rules not processed for user `19f5b8b74dd84d6d93d8afa120bca9df`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:30.577067 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:30.583881 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1450/2897] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:32.390377 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:32.391826 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:32.423412 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:32.462204 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83a05f-b01e-43b6-a91c-87727d86a63e service cinder] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:32.467336 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:32.467982 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:32.468262 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:32.468533 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:32.470299 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:32.482882 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:32.484568 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:32.495984 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1448/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:39.068394 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:39.070046 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:39.140280 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632947d-5064-4389-9898-4e8abba177f8 None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:39.142921 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:39.143733 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:39.144054 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:39.144883 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:39.146472 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:39.158701 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:39.160170 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa3c39-2778-4c39-b2f2-fcc830835b11 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:39.170528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1451/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:42.516379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=19 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:46.668792 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:46.670302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:46.762558 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04c0f7-9fcf-414b-9282-144af7c69133 service placement] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:46.770642 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b281089b494473a7b58228ac75c898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:46.771280 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:46.771564 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:46.771845 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:46.774310 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:46.788059 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:46.789692 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:46.802359 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1449/2900] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:29:49.166564 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=68 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:53.898803 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c98f-4302-4ce7-8d35-3ab955ad3106 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:53.899945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c98f-4302-4ce7-8d35-3ab955ad3106 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:53.899945 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c98f-4302-4ce7-8d35-3ab955ad3106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:53.960528 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-2869c98f-4302-4ce7-8d35-3ab955ad3106 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:53.962299 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-2869c98f-4302-4ce7-8d35-3ab955ad3106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:54.026464 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1452/2901] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:29:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:54.160272 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:54.161691 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:54.251464 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8256c3-379a-46a9-a70b-18e468ffe606 service nova] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:54.256626 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:54.257241 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:54.257521 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:54.257795 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:54.266878 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:54.268486 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:54.277347 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1450/2902] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:29:54.991007 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a436156-0e47-41c4-b325-1cc854a433fc None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:54.992917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a436156-0e47-41c4-b325-1cc854a433fc None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:54.992917 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a436156-0e47-41c4-b325-1cc854a433fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:55.013175 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-0a436156-0e47-41c4-b325-1cc854a433fc None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:55.014393 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-0a436156-0e47-41c4-b325-1cc854a433fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:55.021723 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1453/2903] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:55.034597 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:55.045328 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ac2d1-c3bc-45d2-8a2b-0da565dd6c57 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:55.050368 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:55.051022 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:55.051254 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:55.051523 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:55.060220 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:55.061801 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:55.069776 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1451/2904] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:29:55.703995 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94980bf-82e5-4021-b879-926d09c224e0 None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:55.704355 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94980bf-82e5-4021-b879-926d09c224e0 None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:55.704719 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94980bf-82e5-4021-b879-926d09c224e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:55.723950 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-d94980bf-82e5-4021-b879-926d09c224e0 None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:55.725168 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-d94980bf-82e5-4021-b879-926d09c224e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:55.733174 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1454/2905] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Aug 4 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:55.745676 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:55.756694 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0f52-7554-4ccb-8aa0-cea6702b90a0 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:55.762104 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:55.762709 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:55.763019 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:55.763279 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:55.771524 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:55.773130 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:55.781213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1452/2906] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:29:56.371674 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] REQUEST_METHOD: `POST` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:56.372202 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:56.372397 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:56.392377 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.auth.core [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] MFA Rules not processed for user `568b6aa97ee74544a6a87ad063938d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:56.393577 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:56.401096 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1455/2907] 10.222.0.36 () {58 vars in 967 bytes} [Thu Aug 4 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:56.413379 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:56.424493 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc9e1-f3c0-408f-ab60-ecc8779a8bd9 service swift] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:56.429547 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b0d11d73184d26987ce4bdbfe05514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:56.430165 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] REQUEST_METHOD: `GET` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:56.431121 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:56.431399 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:56.440589 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:56.442185 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba8d52-cac9-4c03-aad0-df8df7b5b7f8 service swift] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:56.453109 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1453/2908] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Aug 4 05:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 05:29:59.128076 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:59.197417 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485d04-f3c2-46ea-bdb7-513536ba351d None None] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:59.202973 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:59.203613 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:59.203895 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:59.204200 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] PATH_INFO: `/v3/users/19f5b8b74dd84d6d93d8afa120bca9df` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:59.205390 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f5b8b74dd84d6d93d8afa120bca9df)` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:59.207320 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:59.477357 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:59.479591 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f5b8b74dd84d6d93d8afa120bca9df'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:59.486670 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f5b8b74dd84d6d93d8afa120bca9df'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:59.487362 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f5b8b74dd84d6d93d8afa120bca9df'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:59.487991 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f5b8b74dd84d6d93d8afa120bca9df'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:59.500534 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.notifications [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f5b8b74dd84d6d93d8afa120bca9df'} {{(pid=80661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:29:59.647405 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1456/2909] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Aug 4 05:29:59 2022] DELETE /identity/v3/users/19f5b8b74dd84d6d93d8afa120bca9df => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:29:59.651993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] REQUEST_METHOD: `POST` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:59.652513 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:59.652618 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:59.674713 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.auth.core [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] MFA Rules not processed for user `fece46a4b9f24d8f8750a8912d1377ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 05:29:59.675983 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:59.686302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=100 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:29:59.739066 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1454/2910] 10.222.0.36 () {58 vars in 958 bytes} [Thu Aug 4 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 05:29:59.749573 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:29:59.751010 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:29:59.810265 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f93e8-fc38-4c05-933d-d8385fdcc216 admin admin] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:29:59.813965 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5915b2a090de42009ef03bf1d5a32f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:29:59.814609 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:29:59.814890 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:29:59.815158 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:29:59.825292 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:29:59.826787 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:29:59.836785 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1457/2911] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 05:30:00.123288 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] Authenticating user token {{(pid=80662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:30:00.124778 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.fernet_utils [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:30:00.138646 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35edcb-ac19-4217-a50f-eb4ddac092cd None None] Validating token access rules against request {{(pid=80662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:30:00.142717 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fece46a4b9f24d8f8750a8912d1377ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc8951b8f50642578f4f541f71fa515c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:30:00.143387 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:30:00.143682 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:30:00.143987 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] PATH_INFO: `/v3/projects/5da21133e47f49ce997a7d8cb6aa4f0c` {{(pid=80662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:30:00.145213 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da21133e47f49ce997a7d8cb6aa4f0c)` {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:30:00.147302 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] RBAC: Authorization granted {{(pid=80662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:30:00.282515 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da21133e47f49ce997a7d8cb6aa4f0c', 'request_id': 'req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:00.288787 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da21133e47f49ce997a7d8cb6aa4f0c', 'request_id': 'req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:00.372859 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da21133e47f49ce997a7d8cb6aa4f0c', 'request_id': 'req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5'} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:00.385505 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] The token cache is being invalidate because project 5da21133e47f49ce997a7d8cb6aa4f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 05:30:00.385791 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:00.386450 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG keystone.notifications [None req-5aa1e28f-26c5-457c-9b8f-f9d049188cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 05:30:00.387993 dv-cinder-852072-1-smb devstack@keystone.service[80662]: [pid: 80662|app: 0|req: 1455/2912] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Aug 4 05:30:00 2022] DELETE /identity/v3/projects/5da21133e47f49ce997a7d8cb6aa4f0c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 05:30:09.832290 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:30:10.381670 dv-cinder-852072-1-smb devstack@keystone.service[80662]: DEBUG dbcounter [-] [80662] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:31:52.278935 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] Authenticating user token {{(pid=80661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 05:31:52.280415 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:31:52.350228 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1de49-c699-4e73-8dac-83d1fcc922c6 service neutron] Validating token access rules against request {{(pid=80661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 05:31:52.408680 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6b3afafa65b40f6a20461377a7f57a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '552b91bdd18248fcb34187159a5a1aad', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 05:31:52.409293 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] REQUEST_METHOD: `GET` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 05:31:52.409572 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] SCRIPT_NAME: `/identity` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 05:31:52.409846 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 05:31:52.411711 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.fernet_utils [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 05:31:52.423404 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 05:31:52.425034 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db7e3-449b-4a81-b0c8-cf4d1b3f4401 service placement] RBAC: Authorization granted {{(pid=80661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 05:31:52.435668 dv-cinder-852072-1-smb devstack@keystone.service[80661]: [pid: 80661|app: 0|req: 1458/2913] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Aug 4 05:31:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 05:32:02.431386 dv-cinder-852072-1-smb devstack@keystone.service[80661]: DEBUG dbcounter [-] [80661] Writing DB stats keystone:SELECT=58 {{(pid=80661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}